CN103533383B - A kind of service trigger method, apparatus and system - Google Patents
A kind of service trigger method, apparatus and system Download PDFInfo
- Publication number
- CN103533383B CN103533383B CN201310447296.7A CN201310447296A CN103533383B CN 103533383 B CN103533383 B CN 103533383B CN 201310447296 A CN201310447296 A CN 201310447296A CN 103533383 B CN103533383 B CN 103533383B
- Authority
- CN
- China
- Prior art keywords
- service
- specified object
- specified
- target video
- identification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the invention discloses a kind of service trigger method, apparatus and system, the treatment expense for reducing terminal improves business triggering response speed.Present invention method includes:The service trigger request that user terminal sends is received, the service trigger request includes:Media identification, service identification and specified object time;Media content extraction is carried out to the corresponding target video of the media identification according to contents extraction strategy and the specified object time;It is determined that specifying object information;Specified object is determined in the media content according to the specified object information;Use the corresponding business of service identification described in the specified objects trigger.
Description
Technical field
The present invention relates to the communications field, more particularly to a kind of service trigger method, apparatus and system.
Background technology
With the development of Digital Media and internet, increasing video starts the life of abundant people.
User while video content plot is paid close attention to, can also produce during video is watched to video content object
Raw interest, and then the demand that can be known about.For example, user is when video is watched, find there is a vapour liked in video pictures
Car, wants further to understand the automobile or buy the automobile, but due to not knowing the letter such as concrete model of the automobile
Breath, therefore, user can only carry out key value search by internet to the automobile occurred in the video, waste time and energy, and
The success rate of search is relatively low.
In the prior art, when user watches video, user can specify object by being selected in video clip, then
Triggering business corresponding with the specified object, but, after specified object is seen in user's selection, user terminal is needed to user
Specified object carries out cumbersome pretreatment operation (e.g., the analysis and identification of image), causes the expense of user terminal larger, and industry
The response time for being engaged in triggering is more long.
The content of the invention
A kind of service trigger method, apparatus and system are the embodiment of the invention provides, the treatment expense for reducing terminal,
Raising business triggers response speed.
The service trigger method that embodiment of the present invention first aspect is provided, including:
The service trigger request that user terminal sends is received, the service trigger request includes:Media identification, service identification
With the specified object time;According to contents extraction strategy and the specified object time in the corresponding target video of the media identification
Middle extraction media content;It is determined that specifying object information;Determined in the media content to specify according to the specified object information
Object;Use the corresponding business of service identification described in the specified objects trigger;
The service trigger request also includes:Specify object information;
It is described to determine that specified object information includes:The specified object information is extracted in the service trigger request;
It is described according to contents extraction strategy and the specified object time is in the corresponding target video of the media identification
Before extracting media content, including:
Carried in the first business content corresponding with the service identification is inquired about in tactful relation table according to the service identification
Take strategy;
Or, according to the specified object information in object with to inquire about the specified object information in tactful relation table corresponding
Contents extraction strategy;
Or, the strategy mark carried in obtaining the service trigger request;According to the strategy mark selection target
The contents extraction strategy of video.
It is described according to contents extraction strategy and the specified object in second possible implementation of first aspect
Before time extracts media content in the corresponding target video of the media identification, including:
Carried in the first business content corresponding with the service identification is inquired about in tactful relation table according to the service identification
Take strategy;
Accordingly, it is described to determine that specified object information includes:Determined to specify object information according to the contents extraction strategy.
With reference to first aspect and the first to three of first aspect any one possible implementation, the of first aspect
In four kinds of possible implementations, the specified object information includes:Specify the area information of object;
If the specified object information be specify object area information, it is described according to the specified object information in institute
Object is specified in determination in stating media content, including:
The media content is converted into characteristic, the characteristic includes:Matrix, each vector in the matrix
Represent each pixel of frame of video;Area information according to the specified object extracts target area in the characteristic
Pixel as specified object, the target area is the region specified by the area information.
With reference to first aspect and the first to three of first aspect any one possible implementation, the of first aspect
In five kinds of possible implementations, the specified object information also includes:Specify the characteristic attribute of object;
If the specified object information be specify object characteristic attribute, it is described according to the specified object information in institute
Object is specified in determination in stating media content, including:
The media content is converted into characteristic, the characteristic includes:Matrix, each vector in the matrix
Represent each pixel of frame of video;Extracted in the characteristic according to the specified characteristics of objects attribute and meet the spy
The data message of attribute is levied as specified object.
With reference to the 4th of first aspect the or five any one possible implementations, in the 6th kind of possible reality of first aspect
In existing mode, it is described the media content is converted into characteristic after, specifically also include:
According to the media identification and the service identification in media data storage, energy in the target video is obtained
The characteristic of the corresponding business of the service identification is enough triggered, and the characteristic being converted to the media content is carried out
Compare;
Under the scene that the specified object information is the area information for specifying object, if the calculating of two characteristics is poor
Value is less than a threshold value, then trigger the basis and specify the area information of object that target area is extracted in the characteristic
Pixel is used as specified object;
Under the scene that the specified object information is the characteristic attribute for specifying object, if the calculating of two characteristics is poor
Value is less than a threshold value, then trigger to be extracted in the characteristic according to the specified characteristics of objects attribute and meet the feature
The data message of attribute is used as specified object.
With reference to first aspect and the first to three of first aspect any one possible implementation, the of first aspect
In seven kinds of possible implementations, the service identification is inquired about in the second business with tactful relation table according to the service identification
Corresponding content analysis strategy;
It is described to be determined in the media content to specify object according to the specified object information, including:
Determined to specify object in the media content according to the content analysis strategy and the specified object information.
With reference to first aspect and the first to seven of first aspect any one possible implementation, the of first aspect
In eight kinds of possible implementations, the contents extraction strategy includes:
A two field picture is extracted at the described specified object time of the target video;
Or, before or after the described specified object time of the target video some durations, extract an at least frame figure
Picture;
Or, a period of time before and after the described specified object time of the target video is interval interior, an at least frame is extracted
Image;
Or, in some durations before or after the described specified object time of the target video, extracting one section of sound
Frequently;
Or, a period of time before and after the described specified object time of the target video is interval interior, a section audio is extracted;
Or, extracting captions at the described specified object time of the target video;
Or, in some durations before or after the described specified object time of the target video, extracting one section of word
Curtain;
Or, a period of time before and after the described specified object time of the target video is interval interior, one section of captions is extracted.
The service trigger method that embodiment of the present invention second aspect is provided, including:
Receive user terminal send the first service trigger request, first service trigger request include media identification and
Specify the object time;According to contents extraction strategy and the specified object time in the corresponding target video of the media identification
Extracting object content;The contents of object is returned to the user terminal so that the user terminal is according to the contents of object
It is determined that specifying object information;Receive the second service trigger request that the user terminal sends, second service trigger request
Including:Specify object information;Determine to specify object according to the specified object information;Obtain the business that the user terminal sends
Mark;Use the corresponding business of service identification described in the specified objects trigger;
It is described according to contents extraction strategy and the specified object time is in the corresponding target video of the media identification
Before extracting object content, including:
Carried in the first business content corresponding with the service identification is inquired about in tactful relation table according to the service identification
Take strategy;
Or, according to the contents extraction strategy of the strategy mark selection target video;
Or, determining the contents extraction strategy of the target video according to the extraction duration information.
In the first possible implementation of second aspect, first service trigger request also includes:Business mark
Know;
Accordingly, the service identification for obtaining user terminal transmission, including:
The service identification is obtained in first service trigger request.
In second possible implementation of second aspect, second service trigger request also includes:Business mark
Know;
Accordingly, the service identification for obtaining user terminal transmission, including:
The service identification is obtained in second service trigger request.
With reference to second aspect and the first to two of second aspect any one possible implementation, the of first aspect
It is described corresponding in the media identification with the specified object time according to contents extraction strategy in three kinds of possible implementations
Target video in extracting object content, specifically include:
An at least two field picture is extracted in the target video according to the specified object time;
The contents of object appeared in an at least two field picture is extracted respectively according to different characteristic attributes, is obtained
To the to be selected specified object group comprising multiple contents of object.
With reference to second aspect and the first to two of second aspect any one possible implementation, the of first aspect
In four kinds of possible implementations, the service trigger request also includes:Strategy mark;
Accordingly, it is described according to contents extraction strategy and the specified object time is in the corresponding target of the media identification
In video before extracting object content, including:
According to the contents extraction strategy of the strategy mark selection target video.
With reference to second aspect and the first to three of second aspect any one possible implementation, the of first aspect
In without the possible implementation of kind, the contents extraction strategy includes:
A two field picture is extracted at the described specified object time of the target video;
Or, before or after the described specified object time of the target video some durations, extract an at least frame figure
Picture;
Or, a period of time before and after the described specified object time of the target video is interval interior, an at least frame is extracted
Image.
The Service Process Server that the embodiment of the present invention third aspect is provided, including:
Receiving unit, the service trigger request for receiving user terminal transmission, the service trigger request includes:Media
Mark, service identification and specified object time;
Extraction unit, for according to contents extraction strategy and the specified object time in the corresponding mesh of the media identification
Media content is extracted in mark video;
Object determining unit, for determining to specify object information, according to the specified object information in the media content
It is middle to determine to specify object;
Service trigger unit, for using the corresponding business of service identification described in the specified objects trigger;
The service trigger request also includes:Specify object information;
The object determining unit specifically for:The specified object information is extracted in the service trigger request;
The Service Process Server also includes:
Policy determining unit is extracted, described in being inquired about in the first business with tactful relation table according to the service identification
The corresponding contents extraction strategy of service identification;Or, inquiring about institute in object with tactful relation table according to the specified object information
State the corresponding contents extraction strategy of specified object information;Or, the strategy mark carried in obtaining the service trigger request;According to
The contents extraction strategy of the strategy mark selection target video.
The object determining unit specifically for:The specified object information is extracted in the service trigger request.
In second possible implementation of the third aspect, the object determining unit specifically for:According to described
Service identification is in the first business contents extraction strategy corresponding with the service identification is inquired about in tactful relation table;According to described interior
Hold and extract the specified object information of strategy determination.
With reference to the third aspect and the first to three of the third aspect any one possible implementation, the of the third aspect
In four kinds of possible implementations, the specified object information includes:Specify the area information of object;
The object determining unit specifically for:If the specified object information is the area information for specifying object, will
The media content is converted to characteristic, and the characteristic includes:Matrix, each vector represents frame of video in the matrix
Each pixel;The pixel that area information according to the specified object extracts target area in the characteristic is made
To specify object, the target area is the region specified by the area information.
With reference to the third aspect and the first to three of the third aspect any one possible implementation, the of the third aspect
In five kinds of possible implementations, the specified object information includes:Specify the characteristic attribute of object;
The object determining unit is specifically additionally operable to:If the specified object information is the characteristic attribute for specifying object,
The media content is converted into characteristic, the characteristic includes:Matrix, each vector represents video in the matrix
Each pixel of frame;Extracted in the characteristic according to the specified characteristics of objects attribute and meet the characteristic attribute
Data message is used as specified object.
With reference to the 4th of the third aspect the or five any one possible implementations, in the 6th kind of possible reality of the third aspect
In existing mode, the object determining unit is specifically additionally operable to:After the media content is converted into characteristic, according to described
Media identification and the service identification can trigger the business mark in media data storage in the acquisition target video
Know the characteristic of corresponding business, and the characteristic being converted to the media content is compared;Specified described
Under object information is the scene of the area information for specifying object, if two calculating differences of characteristic are less than a threshold value,
Triggering the basis specifies the area information of object that the pixel of target area is extracted in the characteristic as specified right
As;Under the scene that the specified object information is the characteristic attribute for specifying object, if the calculating difference of two characteristics is small
In a threshold value, then trigger to be extracted in the characteristic according to the specified characteristics of objects attribute and meet the characteristic attribute
Data message as specified object.
With reference to the third aspect and the first to three of the third aspect any one possible implementation, the of the third aspect
In seven kinds of possible implementations, the Service Process Server also includes:
Analysis strategy determining unit, described in being inquired about in the second business with tactful relation table according to the service identification
The corresponding content analysis strategy of service identification.
With reference to the third aspect and the first to seven of the third aspect any one possible implementation, the of the third aspect
In eight kinds of possible implementations, the contents extraction strategy includes:
A two field picture is extracted at the described specified object time of the target video;
Or, before or after the described specified object time of the target video some durations, extract an at least frame figure
Picture;
Or, a period of time before and after the described specified object time of the target video is interval interior, an at least frame is extracted
Image;
Or, in some durations before or after the described specified object time of the target video, extracting one section of sound
Frequently;
Or, a period of time before and after the described specified object time of the target video is interval interior, a section audio is extracted;
Or, extracting captions at the described specified object time of the target video;
Or, in some durations before or after the described specified object time of the target video, extracting one section of word
Curtain;
Or, a period of time before and after the described specified object time of the target video is interval interior, one section of captions is extracted.
The Service Process Server that embodiment of the present invention fourth aspect is provided, including:
First receiving unit, the first service trigger request for receiving user terminal transmission, the first business triggering
Request includes:Media identification and specified object time;
Contents extracting unit, for corresponding in the media identification with the specified object time according to contents extraction strategy
Target video in extracting object content;
Information feedback unit, for returning to the contents of object to the user terminal so that the user terminal according to
The contents of object determines to specify object information;
Second receiving unit, for receiving the second service trigger request that the user terminal sends, second business
Trigger request includes:Specify object information;
Object determining unit, for determining to specify object according to the specified object information;
Mark acquiring unit, for obtaining the service identification that the user terminal sends;
Service trigger unit, for using the corresponding business of service identification described in the specified objects trigger;
Wherein, the Service Process Server is additionally operable to according to the service identification in the first business with tactful relation table
Inquire about the corresponding contents extraction strategy of the service identification;Or, according to the content of the strategy mark selection target video
Extract strategy;Or, determining the contents extraction strategy of the target video according to the extraction duration information.
The mark acquiring unit specifically for:The service identification is obtained in first service trigger request, or,
The service identification is obtained in second service trigger request.
In the first possible implementation of fourth aspect, the mark acquiring unit specifically for:Described
The service identification is obtained in one service trigger request, or, obtaining the service identification in second service trigger request.
With reference to the first possible implementation of fourth aspect or fourth aspect, in second possible realization, institute
State contents extracting unit specifically for:An at least two field picture is extracted in the target video according to the specified object time;
The contents of object appeared in an at least two field picture is extracted respectively according to different characteristic attributes, is obtained comprising many
The to be selected specified object group of the individual contents of object.
It is possible at the third with reference to fourth aspect or the first to two of fourth aspect any one possible implementation
In realization, the service trigger request also includes:Strategy mark;
The Service Process Server also includes:
Policy determining unit, for the contents extraction strategy according to the strategy mark selection target video.
It is possible at the 4th kind with reference to fourth aspect or the first to three of fourth aspect any one possible implementation
In realization, the contents extraction strategy includes:
A two field picture is extracted at the described specified object time of the target video;
Or, before or after the described specified object time of the target video some durations, extract an at least frame figure
Picture;
Or, a period of time before and after the described specified object time of the target video is interval interior, an at least frame is extracted
Image.
The transaction processing system that the aspect of the embodiment of the present invention the 5th is provided, including:
User terminal and Service Process Server;
The service generation service trigger request that the user terminal is triggered the need for being used to be selected according to user, and to described
Service Process Server sends the service trigger request, and the service trigger request includes:Media identification, service identification and refers to
Determine the object time;
The Service Process Server is used to receive the service trigger request of user terminal transmission, according to contents extraction strategy
With the specified object time media content is extracted in the corresponding target video of the media identification;It is determined that specifying object letter
Breath;Specified object is determined in the media content according to the specified object information;Using described in the specified objects trigger
The corresponding business of service identification;
The service trigger request also includes:Specify object information;
It is described to determine that specified object information includes:The specified object information is extracted in the service trigger request;
It is described according to contents extraction strategy and the specified object time is in the corresponding target video of the media identification
Before extracting media content, including:
Carried in the first business content corresponding with the service identification is inquired about in tactful relation table according to the service identification
Take strategy;
Or, according to the specified object information in object with to inquire about the specified object information in tactful relation table corresponding
Contents extraction strategy;
Or, the strategy mark carried in obtaining the service trigger request;According to the strategy mark selection target
The contents extraction strategy of video.
The transaction processing system that the aspect of the embodiment of the present invention the 6th is provided, including:
User terminal and Service Process Server;
The user terminal is used to generate the first service trigger request, and sends described the to the Service Process Server
One service trigger request, first service trigger request includes:Media identification and specified object time;Receive at the business
Reason server returns to the contents of object so that the user terminal determines to specify object information according to the contents of object;To
Service Process Server sends the second service trigger request, and second service trigger request includes:Specify object information;
The Service Process Server is used to receive the first service trigger request of user terminal transmission, according to contents extraction
Tactful and described extracting object content in the corresponding target video of the media identification of specified object time;To user's end
End returns to the contents of object, receives the second service trigger request that user terminal sends, true according to the specified object information
Surely object is specified;Obtain the service identification that user terminal sends;It is corresponding using service identification described in the specified objects trigger
Business;
It is described according to contents extraction strategy and the specified object time is in the corresponding target video of the media identification
Before extracting object content, including:
Carried in the first business content corresponding with the service identification is inquired about in tactful relation table according to the service identification
Take strategy;
Or, according to the contents extraction strategy of the strategy mark selection target video;
Or, determining the contents extraction strategy of the target video according to the extraction duration information.
As can be seen from the above technical solutions, in embodiments of the present invention, user operate user terminal viewing video when,
If to certain the specified subject interests in video, can be corresponding according to the selection triggering of oneself demand to the specified object
Business, service trigger request is sent to Service Process Server;Service Process Server carries media identification receiving, and specifies
After object information, service identification and the service trigger request of specified object time, according to contents extraction strategy and institute
Stating the specified object time carries out media content extraction to the corresponding target video of the media identification, and according to the specified object
Information determines to specify object in the media content, and then uses the corresponding industry of service identification described in the specified objects trigger
Business.Information required for user can select the business to the specified objects trigger, also, business triggering in operation is led to
Cross service trigger request unification to be sent to Service Process Server and operated, so as to reduce the treatment expense of terminal, improve
Business triggers response speed.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to institute in embodiment
The accompanying drawing for needing to use is briefly described, it should be apparent that, drawings in the following description are only some implementations of the invention
Example, for those of ordinary skill in the art, on the premise of not paying creative work, can also obtain according to these accompanying drawings
Obtain other accompanying drawings.
Fig. 1 is a schematic flow sheet of embodiment of the present invention service trigger method;
Fig. 2 is another schematic flow sheet of embodiment of the present invention service trigger method;
Fig. 3 is another schematic flow sheet of embodiment of the present invention service trigger method;
Fig. 4 is another schematic flow sheet of embodiment of the present invention service trigger method;
Fig. 5 is another schematic flow sheet of embodiment of the present invention service trigger method;
Fig. 6 is the Signalling exchange schematic diagram of embodiment of the present invention service trigger method;
Fig. 7 is a logical construction schematic diagram of embodiment of the present invention Service Process Server;
Fig. 8 is another logical construction schematic diagram of embodiment of the present invention Service Process Server;
Fig. 9 is the structural representation of the Service Process Server based on computer system in the embodiment of the present invention;
Figure 10 is the structural representation of embodiment of the present invention service triggering system.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.It is based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made
Embodiment, belongs to the scope of protection of the invention.
A kind of service trigger method, apparatus and system are the embodiment of the invention provides, it is convenient, flexible for providing the user
Business trigger action.
Fig. 1 is referred to, one embodiment of service trigger method includes in the embodiment of the present invention:
101st, the service trigger request that user terminal sends is received;
Service Process Server receives the service trigger request that user terminal sends, and the service trigger request includes:Matchmaker
Body mark, service identification and specified object time.
The expression information of the video that the media identification is watched by user, the video corresponding to the media identification is target
Video.
The service identification refers to the identification information of the required business to the specified objects trigger of user, can trigger
Type of service have various, such as information inquiry, content analysis, recognition of face etc..
The specified object time is before and after the described specified object that user specifies in the target video occurs
Time point.
Exemplary, in actual applications, when user watches video using user terminal, if being found that sense in video
The specified object of interest, then can in the user terminal select corresponding business to be triggered;Specifically, user can suspend regarding
Frequently, select the business to be triggered, user terminal according to current media identification, selected by time that user suspends and user
Service generation service trigger request, and there is the service trigger request to Service Process Server.
Optionally, the user terminal can be the equipment such as mobile terminal, panel computer.
102nd, according to contents extraction strategy and the specified object time in the corresponding target video of the media identification
Extract media content;
Service Process Server is corresponding in the media identification according to contents extraction strategy and the specified object time
Media content is extracted in target video.
Optionally, the contents extraction strategy can be the contents extraction strategy of acquiescence, it is also possible to according to service identification or
Specified object information determines corresponding contents extraction strategy, can also send specific instruction by service trigger request by user
Information determines corresponding contents extraction strategy, it is to be understood that the determination method of contents extraction strategy can have various, specifically
It is not construed as limiting herein.
Optionally, the media content can be video image, audio or text information.
103rd, determine to specify object information;
Service Process Server determines to specify object information;Optionally, if the service trigger request include it is specified right
Image information, then extract the specified object information in the service trigger request;If not referring in the service trigger request
Determine object information, then can according to the service identification in the first business with to inquire about the service identification in tactful relation table corresponding
Contents extraction strategy, further according to the contents extraction strategy determine specify object information;Do not taken in service trigger request
Band is specified in the scene of object information, and Service Process Server can determine to specify according to the type of service for wanting user to be triggered
Object information, e.g., recognition of face business, the specified object information corresponding to the recognition of face business is face characteristic.
The specified object information is the expression information of specified object in target video, is specifically as follows the image in video
Coordinate, or the authentication code of specific matters, e.g., the authentication code of people or car;It is understood that specifying object information
Can also be the information of the specified object of other expressions, specifically be not construed as limiting herein.
104th, specified object is determined in the media content according to the specified object information;
Service Process Server determines specified object according to the specified object information in the media content.The finger
It is the targeted object of user's triggering corresponding service to determine object.
105th, the corresponding business of service identification described in the specified objects trigger is used.
After it is determined that specifying object, Service Process Server uses service identification correspondence described in the specified objects trigger
Business.
Exemplary, if the business for being triggered is to specify the information inquiry of object, it is assumed that the specified object is car icon,
User wants to inquire about the automobile what plate is car icon represent, then Service Process Server uses the car icon (specified object)
Trigger message inquiry business, information matches are carried out on network using the car icon, after inquiry obtains result, at business
Reason server then feeds back the result of the information inquiry to the user terminal.
The application scenarios in the embodiment of the present invention are illustrated with some examples only below, it is to be understood that
In practical application, there can also be more application scenarios, specifically be not construed as limiting herein.
In embodiments of the present invention, user is when user terminal viewing video is operated, if specifying right to certain in video
As interested, then corresponding business can be triggered according to the selection of oneself demand to the specified object, to Service Process Server
Send service trigger request;Service Process Server carries media identification receiving, and specifies object information, service identification and refers to
After determining the service trigger request of object time, according to contents extraction strategy and the specified object time to the matchmaker
Body identifies corresponding target video and carries out media content extraction, and true in the media content according to the specified object information
Surely object is specified, and then using the corresponding business of service identification described in the specified objects trigger, user in operation may be used
Service trigger request is passed through with the information required for the flexible business selected to the specified objects trigger, also, business triggering
Unification is sent to Service Process Server and is operated, and the flow of business triggering is simple and convenient.
In actual applications, the selected instrument of object (e.g., the selected window of content) that user can be provided by user terminal
Object is specified in selection, and reselection wants the business for the specified objects trigger, Fig. 2 specifically referred to, in the embodiment of the present invention
Another embodiment of service trigger method includes:
201st, object information is specified in user terminal generation;
When user is when target video is watched, if interested in certain things in the target video, user's end is used
The selected instrument selection of the object for providing is held to specify object;After user have selected specified object, user terminal generates this and specifies
The specified object information of object.
Optionally, the selected instrument of the object can be the selected window of content of " circle " or " rectangle ", or letter
Single mouse indicating cursor, it is to be understood that the form of expression of the selected instrument of object can have various, not limit herein specifically
It is fixed.
In embodiments of the present invention, specified object information can be the area information for specifying object, specifically, the region is believed
Cease for specify object frame of video positional information, using coordinate representation (such as:Specify right using the selected window of rectangle content is selected
As then area information can be the rectangle upper left corner and the respective abscissa in the lower right corner and ordinate;Window is selected using circular content
The selected specified object of mouth, then area information can be centre coordinate and radius);
202nd, user terminal determines service identification;
After user have selected specified object, user also needs to select for what business of the specified objects trigger,
User have selected after certain business, and user terminal determines the corresponding service identification of the business based on the business that user selectes.
Exemplary, user sees that certain icon is very interesting in target video, then want to share the icon with friend, then use
After the icon is drawn a circle to approve, the video clip of user terminal just occurs multiple selections of service selection, and user may be selected by family
" sharing business " therein, during the icon shared into the specific social networks of the user.
203rd, user terminal generation service trigger request;
After user have selected certain business, the time that user terminal can select the specified object according to the user is true
Determine the specified object time of business triggering;Obtain again the target video for media identification, generate service trigger request, it is described
Service trigger request includes:Media identification, specifies object information, service identification and specified object time.
Optionally, before service trigger request is generated, according to actual applicable cases, user is also an option that target is regarded
The contents extraction strategy of frequency, user terminal correspondence generation strategy mark.
After service trigger request is generated, user terminal sends the service trigger request to Service Process Server.
204th, Service Process Server receives the service trigger request that user terminal sends;
Service Process Server receives the service trigger request that user terminal sends, and the service trigger request includes:Matchmaker
Body is identified, and specifies object information, service identification and specified object time.
The expression information of the video that the media identification is watched by user, the video corresponding to the media identification is target
Video.
The specified object information is the expression information of specified object in target video, is specifically as follows the image in video
Coordinate, or the authentication code of specific matters, e.g., the authentication code of people or car;It is understood that specifying object information
Can also be the information of the specified object of other expressions, specifically be not construed as limiting herein.
The service identification refers to the identification information of the required business to the specified objects trigger of user, can trigger
Type of service have various, such as information inquiry, content analysis, recognition of face etc..
The specified object time is before and after the described specified object that user specifies in the target video occurs
Time point.
Optionally, the service trigger request is still further comprised:Strategy mark, the strategy identifies corresponding for specifying
Contents extraction strategy.
205th, Service Process Server determines contents extraction strategy;
Optionally, Service Process Server determines that the method for contents extraction strategy has various, can specifically include:
First, according to the service identification in the first business content corresponding with the service identification is inquired about in tactful relation table
Extract strategy.In actual applications, certain business may be fitted with corresponding contents extraction strategy, and in Service Process Server
Can be stored with service identification and the fitting relation table (i.e. described first business and tactful relation table) of contents extraction strategy, therefore
Service Process Server can inquire about corresponding contents extraction strategy according to service identification.
2nd, according to the specified object information in object with to inquire about the specified object information in tactful relation table corresponding
Contents extraction strategy.In actual applications, certain specified object may be fitted with corresponding contents extraction strategy, and Business Processing
Fitting relation table (i.e. described object and the tactful relation of the specified object information that can be stored with server and contents extraction strategy
Table), therefore Service Process Server can inquire about corresponding contents extraction strategy according to specified object information.
3rd, according to the contents extraction strategy of the strategy mark selection target video.In actual applications, user goes back
Specific contents extraction strategy can be selected according to the demand of itself, the strategy mark carried by service trigger request indicates industry
Business processing server selection contents extraction strategy.
It is understood that Service Process Server determine the method for contents extraction strategy have it is various can have various, have
Body is not construed as limiting herein.
206th, Service Process Server according to contents extraction strategy and the specified object time in the media identification pair
Media content is extracted in the target video answered;
Service Process Server is corresponding in the media identification according to contents extraction strategy and the specified object time
Media content is extracted in target video.
Specifically, the contents extraction strategy can include:
A two field picture is extracted at the described specified object time of the target video;
Or, before or after the described specified object time of the target video some durations, extract an at least frame figure
Picture;
Or, a period of time before and after the described specified object time of the target video is interval interior, an at least frame is extracted
Image;
Or, in some durations before or after the described specified object time of the target video, extracting one section of sound
Frequently;
Or, a period of time before and after the described specified object time of the target video is interval interior, a section audio is extracted;
Or, extracting captions at the described specified object time of the target video;
Or, in some durations before or after the described specified object time of the target video, extracting one section of word
Curtain;
Or, a period of time before and after the described specified object time of the target video is interval interior, one section of captions is extracted.
207th, Service Process Server determines specified object according to the specified object information in the media content;
Service Process Server determines specified object according to the specified object information in the media content.
If specifically, the specified object information is the area information for specifying object, it is determined that the method for specified object can
Think:The media content is converted into characteristic, the characteristic includes:Matrix, each vectorial generation in the matrix
Each pixel of table frame of video;Area information according to the specified object extracts target area in the characteristic
Used as specified object, the target area is the region specified by the area information to pixel.
Optionally, before being determined to specify object in the media content according to the specified object information, at business
Reason server can be according to the service identification in the second business is corresponding with the service identification is inquired about in tactful relation table
Hold analysis strategy.In actual applications, various content analysis strategies can be stored in Service Process Server, is adapted to respectively
In different business, because these content analysis strategies are aimed at what different business were customized, accordingly, it is determined that specifying object
Efficiency and success rate it is all higher;And business can be stored in second business and plan with the fitting relation of content analysis strategy
Slightly in relation table.
208th, Service Process Server further determines that specified object;
Optionally, after specified object has been primarily determined that, Service Process Server can also be according to media identification and industry
Business mark can trigger the spy of the corresponding business of the service identification in media data storage in the acquisition target video
Data are levied, and the characteristic being converted to the media content is compared, if the calculating difference of two characteristics is small
In a threshold value, it is determined that the specified object is the specified object that can trigger the business;Exemplary, institute can be calculated
Two Euclidean distances of characteristic are stated, if two Euclidean distances of characteristic are less than a threshold value, it is determined that described to specify
Object is the specified object that can trigger the business.
209th, Service Process Server uses the corresponding business of service identification described in the specified objects trigger.
After it is determined that specifying object, Service Process Server uses service identification correspondence described in the specified objects trigger
Business.
It is exemplary, if the business for being triggered is to specify sharing for object, it is assumed that the specified object is icon, user want by
The icon is shared on specific social networks, then Service Process Server is reserved in the body of local social networks by user
Part checking information, opens the link of corresponding social network sites, and the icon is published on the social network sites.
In actual applications, some business triggering be do not need user selection specify object, that is, have selected the business it
Give tacit consent to afterwards and specify which content object is, user is after it have selected the business for needing triggering, you can send service trigger request,
Fig. 3 is specifically referred to, another embodiment of service trigger method includes in the embodiment of the present invention:
301st, user terminal determines service identification;
The business of triggering required for user's selection, after user have selected certain business, user terminal is selected based on user
Fixed business determines the corresponding service identification of the business.
In embodiments of the present invention, because the selected business of user has given tacit consent to specifically specified object information, therefore,
Without carrying specified object information in service trigger request, service server lateral root will recognise that accordingly automatically according to the service identification
Specified object information, specified object information can be specify object characteristic attribute;Such as:Face, automobile or audio etc..According to
Actual conditions are optional, and the form of expression of characteristic attribute can also have various, it is assumed that it is face to specify object, then the feature of face
Attribute is then the profile information of face.
Exemplary, it is assumed that the business that user selectes is " recognition of face ", then user terminal first determines that " recognition of face " is right
The service identification answered, then determine that it is the characteristic attribute of face to specify object information.
302nd, user terminal generation service trigger request;
After user have selected certain business, the time that user terminal can select the specified object according to the user is true
Determine the specified object time of business triggering;Obtain again the target video for media identification, generate service trigger request, it is described
Service trigger request includes:Media identification, service identification and specified object time.
Optionally, before service trigger request is generated, according to actual applicable cases, user is also an option that target is regarded
The contents extraction strategy of frequency, user terminal correspondence generation strategy mark.
Optionally, user is also an option that the extraction duration information before and after the object time is specified of target video, so as to
In more effectively extracting specified object.In actual applications, due to the reason that video playback is being carried out always, user currently has
The picture of its specified object interested may be had already passed by, so user can select a specific extraction time section to enter
The extraction of the specified object of row.
After service trigger request is generated, user terminal sends the service trigger request to Service Process Server.
303rd, Service Process Server receives the service trigger request that user terminal sends;
Service Process Server receives the service trigger request that user terminal sends, and the service trigger request includes:Matchmaker
Body mark, service identification and specified object time.
The expression information of the video that the media identification is watched by user, the video corresponding to the media identification is target
Video.
The service identification refers to the identification information of the required business to the specified objects trigger of user, can trigger
Type of service have various, such as information inquiry, content analysis, recognition of face etc..
The specified object time is before and after the described specified object that user specifies in the target video occurs
Time point.
Optionally, the service trigger request is still further comprised:Strategy mark and extraction duration information, the strategy mark
Know for specifying corresponding contents extraction strategy;The extraction duration information is used to indicate cut when media content is extracted
The duration of the video for taking.
304th, Service Process Server determines contents extraction strategy;
Service Process Server determines contents extraction strategy, in embodiments of the present invention, is carried corresponding content is determined
Take after strategy, the Objective extraction content that Business Processing service can be in contents extraction strategy determines to specify object information.
Optionally, Service Process Server determines that the method for contents extraction strategy has various, can specifically include:
First, according to the service identification in the first business content corresponding with the service identification is inquired about in tactful relation table
Extract strategy.In actual applications, certain business may be fitted with corresponding contents extraction strategy, and in Service Process Server
Can be stored with service identification and the fitting relation table (i.e. described first business and tactful relation table) of contents extraction strategy, therefore
Service Process Server can inquire about corresponding contents extraction strategy according to service identification.
2nd, according to the contents extraction strategy of the strategy mark selection target video.In actual applications, user goes back
Specific contents extraction strategy can be selected according to the demand of itself, the strategy mark carried by service trigger request indicates industry
Business processing server selection contents extraction strategy.
3rd, the contents extraction strategy of the target video is determined according to the extraction duration information.In actual applications, by
In the reason that video playback is being carried out always, user is currently possible to have already passed by the picture of its specified object interested,
So user can select a specific extraction time section specify the extraction of object;Therefore, selective extraction is being determined
After the contents extraction strategy of the video in a period of time, can also be by described in extraction duration information determination " a period of time "
It is specially how many.Optionally, in actual applications, if the not no extraction duration information, Service Process Server raw content is carried
The extraction duration given tacit consent in strategy is taken to be extracted.
It is understood that Service Process Server determine the method for contents extraction strategy have it is various can have various, have
Body is not construed as limiting herein.
305th, Service Process Server according to contents extraction strategy and the specified object time in the media identification pair
Media content is extracted in the target video answered;
Service Process Server is corresponding in the media identification according to contents extraction strategy and the specified object time
Media content is extracted in target video.
Specifically, the contents extraction strategy can include:
A two field picture is extracted at the described specified object time of the target video;
Or, before or after the described specified object time of the target video some durations, extract an at least frame figure
Picture;
Or, a period of time before and after the described specified object time of the target video is interval interior, an at least frame is extracted
Image;
Or, in some durations before or after the described specified object time of the target video, extracting one section of sound
Frequently;
Or, a period of time before and after the described specified object time of the target video is interval interior, a section audio is extracted;
Or, extracting captions at the described specified object time of the target video.
306th, Service Process Server determines specified object according to the specified object information in the media content;
Service Process Server determines specified object according to the specified object information in the media content.
Specifically, in embodiments of the present invention, the specified object information is the characteristic attribute for specifying object, it is determined that referred to
Determining the method for object can be:The media content is converted into characteristic, the characteristic includes:Matrix, the square
Each vector represents each pixel of frame of video in battle array;Carried in the characteristic according to the specified characteristics of objects attribute
The data message for meeting the characteristic attribute is taken as specified object.Exemplary, it is assumed that the specified object is the feature of face
Attribute, then intercept the coordinate information or Pixel Information of facial contour in the characteristic.
Optionally, before being determined to specify object in the media content according to the specified object information, at business
Reason server can be according to the service identification in the second business is corresponding with the service identification is inquired about in tactful relation table
Hold analysis strategy.In actual applications, various content analysis strategies can be stored in Service Process Server, is adapted to respectively
In different business, because these content analysis strategies are aimed at what different business were customized, accordingly, it is determined that specifying object
Efficiency and success rate it is all higher;And business can be stored in second business and plan with the fitting relation of content analysis strategy
Slightly in relation table.
307th, Service Process Server further determines that specified object;
Optionally, after specified object has been primarily determined that, Service Process Server can also be according to media identification and industry
Business mark can trigger the spy of the corresponding business of the service identification in media data storage in the acquisition target video
Data are levied, and the characteristic being converted to the media content is compared, if the calculating difference of two characteristics is small
In a threshold value, it is determined that the specified object is the specified object that can trigger the business;Exemplary, institute can be calculated
Two Euclidean distances of characteristic are stated, if two Euclidean distances of characteristic are less than a threshold value, it is determined that described to specify
Object is the specified object that can trigger the business.
Optionally, the media data storage can be the internal element module of the Service Process Server, also may be used
Think a database independently of the Service Process Server, concrete implementation mode can according to the actual requirements depending on,
Specifically it is not construed as limiting herein.
308th, Service Process Server uses the corresponding business of service identification described in the specified objects trigger.
After it is determined that specifying object, Service Process Server uses service identification correspondence described in the specified objects trigger
Business.
Exemplary, if the business for being triggered is recognition of face, Service Process Server gets the specified object (i.e.
The pixel of facial contour, or facial contour coordinate) after, on the database or network in carry out inquiry comparison, determine institute
The identity of face is stated, then associates the relevant information of the personage, the result of inquiry is finally fed back into user terminal.
In actual applications, can more accurately determine to specify object in order that obtaining user, first target video can be entered
The analysis of row contents of object, specifically refers to Fig. 4, and another embodiment of service trigger method includes in the embodiment of the present invention:
401st, user terminal initiates triggering service request;
User is when video is watched, if the video is live signal, user cannot accurately get specified object for the moment
Image information, therefore, it can first to service process terminal send the first service trigger request, requested service processing terminal is to mesh
Mark video carries out the analysis of contents of object, and the analysis result of period returning an object value content can be clearly and accurately in order to user
To specifying object to select.
Specifically, when user initiates the first service trigger request, user terminal can be by the broadcasting of current goal video
Duration is defined as specifying the object time.
402nd, Service Process Server receives the first service trigger request that user terminal sends;
Service Process Server receives the first service trigger request that user terminal sends, first service trigger request
Including:Media identification and specified object time.
The expression information of the video that the media identification is watched by user, the video corresponding to the media identification is target
Video.
The specified object time is before and after the described specified object that user specifies in the target video occurs
Time point.
Optionally, first service trigger request is still further comprised:Strategy mark and extraction duration information, the plan
Slightly identify for specifying corresponding contents extraction strategy;The extraction duration information is used to indicate when media content extraction is carried out
The duration of the video for being intercepted.
403rd, Service Process Server according to contents extraction strategy and the specified object time in the media identification pair
Extracting object content in the target video answered;
Service Process Server is corresponding to the media identification according to contents extraction strategy and the specified object time
Target video carries out contents of object extraction, specifically, Service Process Server according to the specified object time in the target
An at least two field picture is extracted in video;According to different characteristic attributes respectively in the object that a two field picture occurs described at least
Appearance is extracted, and obtains the to be selected specified object group comprising multiple contents of object.
404th, Service Process Server returns to the contents of object to the user terminal;
Service Process Server returns to the contents of object to the user terminal so that the user terminal is according to
Contents of object determines to specify object information.
Exemplary, Service Process Server to teleservice triggered response message, and can be triggered in the business
The object group to be selected is carried in response message;Specifically, the object group to be selected includes multiple contents of object, it is the plurality of right
As the things occurred at least two field picture that content is extracted in the target video, such as:" people ", " desk ", " teacup ",
" potted plant " etc..
405th, user terminal determines to specify object information;
After the contents of object for receiving Service Process Server return, user checks the right of the specified object group to be selected
As content, therefrom select to specify object.
User have selected after specified object, and user terminal determines the corresponding specified object information of the specified object, at this
In inventive embodiments, the specified object information can be an authentication code for indicating the specified object, or refer to
Determine the area information of object.
Optionally, in embodiments of the present invention, after user have selected specified object, it is also an option that required for this
The business of objects trigger is specified, accordingly, user terminal determines the corresponding service identification of the business.
After user terminal determines to specify object information and service identification, user terminal is to the Service Process Server
Send the second service trigger request.
406th, Service Process Server receives the second service trigger request that user terminal sends;
Service Process Server receives the second service trigger request that user terminal sends, second service trigger request
Including:Specify object information.
Further, in embodiments of the present invention, second service trigger request can also include:Service identification.
407th, Service Process Server uses the corresponding business of service identification described in the specified objects trigger.
After second service trigger request is received, Service Process Server determines according to the specified object information
Object is specified, then obtains the service identification carried in second service trigger request, reuse the specified objects trigger institute
State the corresponding business of service identification.
In actual applications, if the specified object information that the business of user's selection is not given tacit consent to indicates (such as sharing business),
And user is not easy to directly specify object in the target video selection played, then can use the scheme described by Fig. 5 embodiments,
Fig. 5 is specifically referred to, another embodiment of service trigger method includes in the embodiment of the present invention:
501st, user terminal determines service identification;
The business of triggering required for user's selection, after user have selected certain business, user terminal is selected based on user
Fixed business determines the corresponding service identification of the business.
502nd, user terminal initiates triggering service request;
User is when video is watched, if the video is live signal, user cannot accurately get specified object for the moment
Image information, therefore, it can first to service process terminal send the first service trigger request, requested service processing terminal is to mesh
Mark video carries out the analysis of contents of object, and the analysis result of period returning an object value content can be clearly and accurately in order to user
To specifying object to select.
Specifically, when user initiates the first service trigger request, user terminal can be by the broadcasting of current goal video
Duration is defined as specifying the object time.In embodiments of the present invention, the first service trigger request carries service identification.
503rd, Service Process Server receives the first service trigger request that user terminal sends;
Service Process Server receives the first service trigger request that user terminal sends, first service trigger request
Including:Service identification, media identification and specified object time.
The expression information of the video that the media identification is watched by user, the video corresponding to the media identification is target
Video.
The specified object time is before and after the described specified object that user specifies in the target video occurs
Time point.
Optionally, first service trigger request is still further comprised:Strategy mark and extraction duration information, the plan
Slightly identify for specifying corresponding contents extraction strategy;The extraction duration information is used to indicate when media content extraction is carried out
The duration of the video for being intercepted.
504th, Service Process Server according to contents extraction strategy and the specified object time in the media identification pair
Extracting object content in the target video answered;
Optionally, Service Process Server determines that the method for contents extraction strategy has various, can specifically include:
First, according to the service identification in the first business content corresponding with the service identification is inquired about in tactful relation table
Extract strategy.In actual applications, certain business may be fitted with corresponding contents extraction strategy, and in Service Process Server
Can be stored with service identification and the fitting relation table (i.e. described first business and tactful relation table) of contents extraction strategy, therefore
Service Process Server can inquire about corresponding contents extraction strategy according to service identification.
2nd, according to the contents extraction strategy of the strategy mark selection target video.In actual applications, user goes back
Specific contents extraction strategy can be selected according to the demand of itself, the strategy mark carried by service trigger request indicates industry
Business processing server selection contents extraction strategy.
3rd, the contents extraction strategy of the target video is determined according to the extraction duration information.In actual applications, by
In the reason that video playback is being carried out always, user is currently possible to have already passed by the picture of its specified object interested,
So user can select a specific extraction time section specify the extraction of object;Therefore, selective extraction is being determined
After the contents extraction strategy of the video in a period of time, can also be by described in extraction duration information determination " a period of time "
It is specially how many.Optionally, in actual applications, if the not no extraction duration information, Service Process Server raw content is carried
The extraction duration given tacit consent in strategy is taken to be extracted.
It is understood that Service Process Server determine the method for contents extraction strategy have it is various can have various, have
Body is not construed as limiting herein.
Specifically, the contents extraction strategy can include:
A two field picture is extracted at the described specified object time of the target video;Or, in the institute of the target video
Some durations before or after the specified object time are stated, an at least two field picture is extracted;Or, being specified in the described of the target video
A period of time before and after the object time is interval interior, extracts an at least two field picture.
After an at least two field picture is extracted, an at least two field picture is gone out respectively according to different characteristic attributes
Existing contents of object is extracted, and obtains the to be selected specified object group comprising multiple contents of object.
505th, Service Process Server returns to the contents of object to the user terminal;
Service Process Server returns to the contents of object to the user terminal so that the user terminal is according to
Contents of object determines to specify object information.
Exemplary, Service Process Server to teleservice triggered response message, and can be triggered in the business
The object group to be selected is carried in response message;Specifically, the object group to be selected includes multiple contents of object, it is the plurality of right
As the things occurred at least two field picture that content is extracted in the target video, such as:" people ", " desk ", " teacup ",
" potted plant " etc..
506th, user terminal determines to specify object information;
After the contents of object for receiving Service Process Server return, user checks the right of the specified object group to be selected
As content, therefrom select to specify object.
User have selected after specified object, and user terminal determines the corresponding specified object information of the specified object, at this
In inventive embodiments, the specified object information can be an authentication code for indicating the specified object, or refer to
Determine the area information of object.
After user terminal determines to specify object information, user terminal sends the second industry to the Service Process Server
Business trigger request.
507th, Service Process Server receives the second service trigger request that user terminal sends;
Service Process Server receives the second service trigger request that user terminal sends, second service trigger request
Including:Specify object information.
508th, Service Process Server uses the corresponding business of service identification described in the specified objects trigger.
After second service trigger request is received, Service Process Server determines according to the specified object information
Object is specified, then obtains the service identification carried in first service trigger request, reuse the specified objects trigger institute
State the corresponding business of service identification.
In order to make it easy to understand, obtaining the concrete application scene of business to described in the above embodiments with reward voucher below
Service trigger method is described in detail again, refer to Fig. 6, specially:
601st, Service Process Server addition reward voucher obtains business information;
When needing to increase reward voucher acquisition business for video, Business Processing service is obtained default for triggering reward voucher
The information for taking business is added to media data storage.
Specifically, can be that service provider passes through one when service provider needs to increase a business newly for video
The default information that business is obtained for triggering reward voucher of web interface input.Specifically can include media identification, video address,
Service identification, business description, business application module specifies object identity, specifies object factory, specifies characteristics of objects data, refers to
Determine object conversion information, contents extraction strategy mark, contents extraction strategy, content analysis strategy mark, content analysis strategy etc.
Information.
Media data storage includes following tables of data, when a business is added for video, i.e., adds phase to tables of data
The data answered.
1.video_service_object tables
Media identification, the service identification that video has extended are have recorded, and the finger of business can be triggered in video
Determine object identity.It is empty just to start table, and structure is as follows:
videoID | serviceID | objectID |
Update later table as follows:
videoID | serviceID | objectID |
content1 | service1 | Logo1 |
Wherein:
videoID:Media identification.In the present embodiment, media identification is content1;
serviceID:Service identification.In the present embodiment, service identification is service1;
objectID:Specify object identity.In the present embodiment, it is object1 to specify object identity;
In the present invention is implemented, media identification does not extend any business in advance for the video of content1, this
Shi Weiqi increases service identification for the reward voucher of service1 obtains business, and has one in video
The specified object identity that the business can be triggered is the commodity icon of Logo 1.
2.business_extract tables
The service identification of all business is have recorded, and the contents extraction strategy of business is identified.It is empty, knot just to start table
Structure is as follows:
serviceID | extractID |
Update later table as follows:
serviceID | extractID |
service1 | extract1 |
extractID:Contents extraction strategy is identified.In the present embodiment, contents extraction strategy is designated extract1;
3.business_analysis tables
The service identification of all business is have recorded, and the content analysis strategy of business is identified.It is empty, knot just to start table
Structure is as follows:
serviceID | analysisID |
Update later table as follows:
serviceID | analysisID |
service1 | analysis1 |
analysisID:Content analysis strategy is identified.In the present embodiment, content analysis strategy is designated analysis1;
4.business tables
Have recorded the service identification of all business, business description, business application module address.It is empty, knot just to start table
Structure is as follows:
serviceID | service_description | service_url |
Update later table as follows:
service_description:Business description, introduces basic use information of business etc.;
service url:The address of business application module, that is, realize the server address of business function;
5.object tables
The mark of all specified objects is have recorded, object factory is specified, characteristics of objects data are specified, object conversion letter is specified
Breath.It is empty just to start table, and structure is as follows:
objectID | object_media | object_characteristics | object_convert_data |
Update later table as follows:
Wherein:
objectID:Specify object identity.In the present embodiment, it is icon 1 to specify object identity;
object_media:Specify object factory, such as picture, audio, text.For picture and audio, can deposit
Local store path;
object_characteristics:Specify characteristics of objects data, the i.e. characteristic of picture, audio etc..
object_convert_data:Specify the conversion information of object.
In embodiment one, specify object identity to have corresponding picture for the commodity icon of Logo1, there is corresponding characteristic
According to, and conversion information Logo ID.
6.extract tables
All of contents extraction strategy mark is have recorded, contents extraction strategy is locally stored path.Just start table be it is empty,
Structure is as follows:
extracteID | extract_file |
Update later table as follows:
extract_file:Contents extraction strategy, can be local store path;
Wherein, the form of contents extraction strategy can be script etc..
7.analysis tables
All of content analysis strategy mark is have recorded, content analysis strategy is locally stored path.Just start table structure such as
Under:
analysisID | analysis_file |
Update later table as follows:
analysis_file:Content analysis strategy, can be local store path;
Wherein, content analysis strategy form can be script etc..
8.video tables
Have recorded the media identification of all videos, and video address.It is empty just to start table, and structure is as follows:
videoed | video_url |
Update later table as follows:
videoID:Media identification.It is content1 in the present embodiment;
video_url:Video address;
602nd, Service Process Server injects business information to video server;
In this step, reward voucher is obtained service identification service1 by Service Process Server, and reward voucher obtains business text
This description, it is the commodity icon of logo1 to specify object identity, will be sent out as the metadata of the video that media identification is content1
Deliver to video server;Be stored in local database for these metadata informations and video corresponding relation by video server.
Exemplary, in actual applications, video server can be electric program menu (EPG, Electronic
Program Guide) server.
603rd, the video traffic of user terminal broadcast video server;
When user opens user terminal, user terminal requests video server issues EPG main interfaces.User can navigate to
Video details interface.In the interface, user can also check the excellent of the Video Expansion except video details in itself are checked
Favour certificate obtains business information, including reward voucher obtains the description of business text, and reward voucher acquisition business is triggered in the video
Commodity icon etc..
In embodiments of the present invention, user terminal requests play video, according to media identification content1, request video clothes
Business device issues video flowing, provides the user video playback service.
604th, user terminal sends service trigger request to Service Process Server;
When user is when target video is watched, if interested in certain things in the target video, user's end is used
The selected instrument selection of the object for providing is held to specify object;After user have selected specified object, user terminal generates this and specifies
The specified object information (can be in embodiments of the present invention the area information of commodity icon) of object.
Optionally, the selected instrument of the object can be the selected window of content of " circle " or " rectangle ", or letter
Single mouse indicating cursor, it is to be understood that the form of expression of the selected instrument of object can have various, not limit herein specifically
It is fixed.
User selects " reward voucher acquisition business ", that is, trigger reward voucher and obtain business.Sent to Service Process Server
Service trigger request message, including (media identification content1, reward voucher obtains the service identification service1 of business, commodity
Icon time of occurrence 23 seconds, commodity icon area information ((200,300), 30));
Trigger action is finished, and user terminal continues to play video or continues to suspend video, and latency services treatment service
Device returns to the implementing result that reward voucher obtains business.
605th, Service Process Server carries out video content extraction to target video, and uses the specified objects trigger institute
State the corresponding business of service identification;
Service Process Server is received after the service trigger request of user terminal transmission, in extraction service trigger request
The media identification of carrying, specifies object information, service identification and specified object time;And contents extraction is determined according to service identification
Strategy.Optionally, according to the service identification in the first business is corresponding with the service identification is inquired about in tactful relation table
Hold and extract strategy.In actual applications, certain business may be fitted with corresponding contents extraction strategy, and Service Process Server
In can be stored with the fitting relation table of service identification and contents extraction strategy, so Service Process Server can be according to business
The corresponding contents extraction strategy of mark inquiry.
Service Process Server is corresponding to the media identification according to contents extraction strategy and the specified object time
Target video carries out media content extraction.Such as, a two field picture is extracted at the described specified object time of the target video.Carry
After having taken media content, specified object is determined in the media content further according to the specified object information;Such as, with (200,
300) it is, 30) parameter, the region is split in the video image for extracting, extracts commodity icon.
Optionally, after specified object has been primarily determined that, Service Process Server can also be according to media identification and industry
Business mark can trigger the commodity of the service identification correspondence business in media data storage in the acquisition target video
The view data of icon, and with (200,300), 30) for parameter extraction to the view data of commodity icon be compared, if two
The calculating difference of individual characteristic is less than a threshold value, it is determined that the specified object is can trigger the business specified right
As the flow of business triggering can be continued;If two calculating differences of characteristic are more than or equal to a threshold value, it is determined that carry
The commodity icon got can not trigger the icon for obtaining coupon business, and Service Process Server can be returned to user terminal
Return corresponding error message.
Exemplary, the Euclidean distance of described two characteristics can be calculated, if two Euclidean distances of characteristic
Less than a threshold value, it is determined that the specified object is the specified object that can trigger the business.
After it is determined that specifying object, Service Process Server uses service identification correspondence described in the specified objects trigger
Business.In embodiments of the present invention, user's triggering is that reward voucher obtains business, however, it is determined that the selected commodity icon of user can
Corresponding business is triggered, then Service Process Server can share on specific social networks the selected commodity icon of user,
And obtain corresponding reward voucher from the social networks.
606th, user terminal receives the service processing result that Service Process Server is returned.
If the selected commodity icon of user can trigger corresponding business, Service Process Server gets corresponding preferential
After certificate, the reward voucher is sent to the user terminal.
If the selected commodity icon of user can not trigger corresponding business, Service Process Server can be to user terminal
Return to corresponding error message.
The application scenarios in the embodiment of the present invention are illustrated with some examples only above, it is to be understood that
In practical application, there can also be more application scenarios, specifically be not construed as limiting herein.
The embodiment to the Service Process Server of the present invention for performing above-mentioned service trigger method is illustrated below,
Its logical construction refer to Fig. 7, and the Service Process Server one embodiment in the embodiment of the present invention includes:
Receiving unit 701, the service trigger request for receiving user terminal transmission, the service trigger request includes:
Media identification, service identification and specified object time;
Extraction unit 702, for corresponding in the media identification with the specified object time according to contents extraction strategy
Target video in extract media content;
Object determining unit 703, for determining to specify object information, according to the specified object information in the media
Determine to specify object in appearance;
Service trigger unit 704, for using the corresponding business of service identification described in the specified objects trigger.
Further, the service trigger request also includes:Specify object information;
The object determining unit 703 specifically for:The specified object information is extracted in the service trigger request.
Further, the object determining unit specifically for:Closed with strategy in the first business according to the service identification
It is to inquire about the corresponding contents extraction strategy of the service identification in table;Determined to specify object letter according to the contents extraction strategy
Breath.
Further, the Service Process Server also includes:
Policy determining unit 705 is extracted, for being inquired about in the first business with tactful relation table according to the service identification
The corresponding contents extraction strategy of the service identification;Or, being looked into object with tactful relation table according to the specified object information
Ask the corresponding contents extraction strategy of the specified object information;Or, the strategy mark carried in obtaining the service trigger request;
According to the contents extraction strategy of the strategy mark selection target video.
Further, the contents extraction strategy includes:
A two field picture is extracted at the described specified object time of the target video;
Or, before or after the described specified object time of the target video some durations, extract an at least frame figure
Picture;
Or, a period of time before and after the described specified object time of the target video is interval interior, an at least frame is extracted
Image;
Or, in some durations before or after the described specified object time of the target video, extracting one section of sound
Frequently;
Or, a period of time before and after the described specified object time of the target video is interval interior, a section audio is extracted;
Or, extracting captions at the described specified object time of the target video;
Or, in some durations before or after the described specified object time of the target video, extracting one section of word
Curtain;
Or, a period of time before and after the described specified object time of the target video is interval interior, one section of captions is extracted.
Further, the specified object information includes:
Specify object area information, or specified object characteristic attribute.
Further, the object determining unit 703 specifically for:If the specified object information is to specify the area of object
Domain information, then be converted to characteristic by the media content, and the characteristic includes:Matrix, in the matrix it is each to
Amount represents each pixel of frame of video;Area information according to the specified object extracts target area in the characteristic
Used as specified object, the target area is the region specified by the area information to the pixel in domain;
If or, the specified object information is the characteristic attribute for specifying object, media content conversion is characterized
Data, the characteristic includes:Matrix, each vector represents each pixel of frame of video in the matrix;According to described
Specify characteristics of objects attribute that the data message for meeting the characteristic attribute is extracted in the characteristic as specified object.
Further, the object determining unit is specifically additionally operable to:After the media content is converted into characteristic,
According to the media identification and the service identification in media data storage, institute can be triggered in the acquisition target video
The characteristic of the corresponding business of service identification is stated, and the characteristic being converted to the media content is compared;
Under the specified object information is the scene of the area information for specifying object, if two calculating differences of characteristic are less than one
Threshold value, then trigger the basis and specify the area information of object that the pixel conduct of target area is extracted in the characteristic
Specify object;Under the scene that the specified object information is the characteristic attribute for specifying object, if two calculating of characteristic
Difference is less than a threshold value, then trigger to be extracted in the characteristic according to the specified characteristics of objects attribute and meet the spy
The data message of attribute is levied as specified object.
Further, the Service Process Server also includes:
Analysis strategy determining unit 706, for being inquired about in the second business with tactful relation table according to the service identification
The corresponding content analysis strategy of the service identification.
The specific operation process of above-mentioned unit/module, including:
In actual applications, when user watches video using user terminal, if being found that finger interested in video
Determine object, then can in the user terminal select corresponding business to be triggered;Specifically, user can suspend video, selection
The business to be triggered, user terminal is according to current media identification, the time of user's pause and the selected business of user
Generation service trigger request, and there is the service trigger request to Service Process Server.
Receiving unit 701 receives the service trigger request that user terminal sends, and the service trigger request includes:Media mark
Know, specify object information, service identification and specified object time.
The expression information of the video that the media identification is watched by user, the video corresponding to the media identification is target
Video.The specified object information is the expression information of specified object in target video, and the image being specifically as follows in video is sat
Mark, or the authentication code of specific matters, e.g., the authentication code of people or car;It is understood that specifying object information also
Can be the information of the specified object of other expressions, specifically be not construed as limiting herein.The service identification refers to right required for user
The identification information of the business of the specified objects trigger, the type of service that can be triggered has various, such as information inquiry, content analysis,
Recognition of face etc..The specified object time is before and after the described specified object that user specifies in the target video occurs
Individual time point.
Optionally, the service trigger request is still further comprised:Strategy mark, the strategy identifies corresponding for specifying
Contents extraction strategy.
After service trigger request is received, when extraction unit 702 is according to contents extraction strategy and the specified object
Between extract media content in the corresponding target video of the media identification.
Optionally, before media content extraction is carried out, extracting policy determining unit 705 can be according to the service identification
In the first business contents extraction strategy corresponding with the service identification is inquired about in tactful relation table;Or, specifying right according to described
Image information is in object contents extraction strategy corresponding with the specified object information is inquired about in tactful relation table;Or, obtaining described
The strategy mark carried in service trigger request;According to the contents extraction strategy of the strategy mark selection target video.
Optionally, Service Process Server determines that the method for contents extraction strategy has various, can specifically include:
First, according to the service identification in the first business content corresponding with the service identification is inquired about in tactful relation table
Extract strategy.In actual applications, certain business may be fitted with corresponding contents extraction strategy, and in Service Process Server
Can be stored with service identification and the fitting relation table (i.e. described first business and tactful relation table) of contents extraction strategy, therefore
Service Process Server can inquire about corresponding contents extraction strategy according to service identification.
2nd, according to the specified object information in object with to inquire about the specified object information in tactful relation table corresponding
Contents extraction strategy.In actual applications, certain specified object may be fitted with corresponding contents extraction strategy, and Business Processing
Fitting relation table (i.e. described object and the tactful relation of the specified object information that can be stored with server and contents extraction strategy
Table), therefore Service Process Server can inquire about corresponding contents extraction strategy according to specified object information.
3rd, according to the contents extraction strategy of the strategy mark selection target video.In actual applications, user goes back
Specific contents extraction strategy can be selected according to the demand of itself, the strategy mark carried by service trigger request indicates industry
Business processing server selection contents extraction strategy.
Specifically, the contents extraction strategy can include:Carried at the described specified object time of the target video
Take a two field picture;Or, before or after the described specified object time of the target video some durations, extract an at least frame
Image;Or, a period of time before and after the described specified object time of the target video is interval interior, an at least frame figure is extracted
Picture;Or, in some durations before or after the described specified object time of the target video, extracting a section audio;Or,
A period of time before and after the described specified object time of the target video is interval interior, extracts a section audio;Or, in the mesh
Mark and captions are extracted at the described specified object time of video;Or, before the described specified object time of the target video or
In some durations afterwards, one section of captions is extracted;Or, in a section before and after the described specified object time of the target video
Between it is interval in, extract one section of captions.
It is understood that Service Process Server determine the method for contents extraction strategy have it is various can have various, have
Body is not construed as limiting herein.
Optionally, before it is determined that specifying object, analysis strategy determining unit 706 is according to the service identification in the second industry
Business content analysis strategy corresponding with the service identification is inquired about in tactful relation table.In actual applications, Business Processing service
Various content analysis strategies can be stored in device, different business is adapted to respectively, because these content analysis strategies are pins
It is customized for different business, accordingly, it is determined that specifying the efficiency and success rate of object all higher;And business and content point
Analysing the fitting relation of strategy can store in second business with tactful relation table.
Object determining unit 703 determines specified object according to the specified object information in the media content.Specifically
, if the specified object information is the area information for specifying object, it is determined that specifying the method for object can be:By the matchmaker
Hold in vivo and be converted to characteristic, the characteristic includes:Matrix, each vector represents each of frame of video in the matrix
Pixel;Area information according to the specified object extracts the pixel of target area as specified in the characteristic
Object, the target area is the region specified by the area information.Optionally, according to the specified object information in institute
Stating before determine in media content and specifying object, Service Process Server can be according to the service identification in the second business and plan
Slightly the corresponding content analysis strategy of the service identification is inquired about in relation table.In actual applications, can in Service Process Server
To store various content analysis strategies, different business is adapted to respectively, because these content analysis strategies are aimed at not
What same business was customized, accordingly, it is determined that specifying the efficiency and success rate of object all higher;And business and content analysis strategy
Fitting relation can store in second business with tactful relation table.
After it is determined that specifying object, service trigger unit 704 uses service identification pair described in the specified objects trigger
The business answered.Exemplary, if the business for being triggered is to specify sharing for object, it is assumed that the specified object is icon, user thinks
The icon is shared on specific social networks, then Service Process Server is reserved in local social networks by user
Authentication information, opens the link of corresponding social network sites, and the icon is published on the social network sites.
Fig. 9 is referred to, the embodiment of the present invention additionally provides a kind of Service Process Server, it may include:
Input unit 901, output device 902, memory 903 and the (processor in Service Process Server of processor 904
Quantity can be one or more, in Fig. 9 by taking a processor as an example) in some embodiments of the invention, input unit
901, output device 902, memory 903 and processor 904 can be connected by bus or other manner, wherein, by total in Fig. 9
As a example by line connection.
Wherein, the processor 904 performs following steps:
After input unit 901 receives the service trigger request that user terminal sends, processor 904 is according to contents extraction
The tactful and described specified object time extracts media content in the corresponding target video of the media identification;It is determined that specifying object
Information;Specified object is determined in the media content according to the specified object information;Use the specified objects trigger institute
State the corresponding business of service identification.After related service is triggered, output device 902 returns to the business and touches to user terminal
The result of hair.
Wherein, the content of the storage of memory 903 includes:
The service trigger request includes:Media identification, service identification and specified object time;
Optionally, the service trigger request also includes:Specify object information;
The specified object information includes:Specify object area information, or specified object characteristic attribute;
Optionally, the contents extraction strategy includes:
A two field picture is extracted at the described specified object time of the target video;
Or, before or after the described specified object time of the target video some durations, extract an at least frame figure
Picture;
Or, a period of time before and after the described specified object time of the target video is interval interior, an at least frame is extracted
Image;
Or, in some durations before or after the described specified object time of the target video, extracting one section of sound
Frequently;
Or, a period of time before and after the described specified object time of the target video is interval interior, a section audio is extracted;
Or, extracting captions at the described specified object time of the target video;
Or, in some durations before or after the described specified object time of the target video, extracting one section of word
Curtain;
Or, a period of time before and after the described specified object time of the target video is interval interior, one section of captions is extracted.
The embodiment to the Service Process Server of the present invention for performing above-mentioned service trigger method is illustrated below,
Its logical construction refer to Fig. 8, and the Service Process Server in the embodiment of the present invention another embodiment includes:
First receiving unit 801, the first service trigger request for receiving user terminal transmission, first business is touched
Hair request includes:Media identification and specified object time;
Contents extracting unit 802, for according to contents extraction strategy and the specified object time in the media identification
Extracting object content in corresponding target video;
Information feedback unit 803, for returning to the result that the contents of object is extracted to the user terminal so that described
The result that user terminal is extracted according to the media content determines to specify object information;
Second receiving unit 804, for receiving the second service trigger request that the user terminal sends, second industry
Business trigger request includes:Specify object information;
Object determining unit 805, for determining to specify object according to the specified object information;
Mark acquiring unit 806, for obtaining the service identification that the user terminal sends;
Service trigger unit 807, for using the corresponding business of service identification described in the specified objects trigger.
Further, the mark acquiring unit 806 specifically for:Obtained in first service trigger request described
Service identification, or, obtaining the service identification in second service trigger request.
Further, the contents extracting unit 802 specifically for:Regarded in the target according to the specified object time
An at least two field picture is extracted in frequency;According to different characteristic attributes respectively to the contents of object that at least a two field picture occurs
Extracted, obtained the to be selected specified object group comprising multiple contents of object.
Further, the service trigger request also includes:Strategy mark;
The Service Process Server also includes:
Policy determining unit 808, for the contents extraction strategy according to the strategy mark selection target video.
Further, the contents extraction strategy includes:
A two field picture is extracted at the described specified object time of the target video;
Or, before or after the described specified object time of the target video some durations, extract an at least frame figure
Picture;
Or, a period of time before and after the described specified object time of the target video is interval interior, an at least frame is extracted
Image.
The specific operation process of above-mentioned unit/module, including:
In actual applications, when user watches video using user terminal, if being found that finger interested in video
Determine object, then can in the user terminal select corresponding business to be triggered;Specifically, user can suspend video, selection
The business to be triggered, user terminal is according to current media identification, the time of user's pause and the selected business of user
Generation service trigger request, and there is the service trigger request to Service Process Server.
First receiving unit 801 receives the first service trigger request that user terminal sends, and the first business triggering please
Ask including:Media identification and specified object time.
The expression information of the video that the media identification is watched by user, the video corresponding to the media identification is target
Video.
The specified object time is before and after the described specified object that user specifies in the target video occurs
Time point.
Optionally, first service trigger request is still further comprised:Strategy mark and extraction duration information, the plan
Slightly identify for specifying corresponding contents extraction strategy;The extraction duration information is used to indicate when media content extraction is carried out
The duration of the video for being intercepted.
After the first service trigger request is obtained, contents extracting unit 802 is according to contents extraction strategy and the finger
Determine the object time carries out contents of object extraction to the corresponding target video of the media identification, specifically, Service Process Server
An at least two field picture is extracted in the target video according to the specified object time;It is right respectively according to different characteristic attributes
The contents of object that a two field picture occurs described at least is extracted, and obtains to be selected specified right comprising multiple contents of object
As group.
After the contents of object is obtained, information feedback unit 803 is returned in the object to the user terminal
Hold so that the user terminal determines to specify object information according to the contents of object.
Exemplary, Service Process Server to teleservice triggered response message, and can be triggered in the business
The object group to be selected is carried in response message;Specifically, the object group to be selected includes multiple contents of object, it is the plurality of right
As the things occurred at least two field picture that content is extracted in the target video, such as:" people ", " desk ", " teacup ",
" potted plant " etc..
After the contents of object for receiving Service Process Server return, user checks the right of the specified object group to be selected
As content, therefrom select to specify object.
User have selected after specified object, and user terminal determines the corresponding specified object information of the specified object, at this
In inventive embodiments, the specified object information can be an authentication code for indicating the specified object, or refer to
Determine the area information of object.
Optionally, in embodiments of the present invention, after user have selected specified object, it is also an option that required for this
The business of objects trigger is specified, accordingly, user terminal determines the corresponding service identification of the business.
After the contents of object for receiving Service Process Server return, the second receiving unit 804 receives user terminal hair
The second service trigger request sent, second service trigger request includes:Specify object information.Further, in the present invention
In embodiment, second service trigger request can also include:Service identification.
After second service trigger request is received, object determining unit 805 is true according to the specified object information
Surely object is specified, then the service identification carried in second service trigger request is obtained by mark acquiring unit 806, most
Afterwards, service trigger unit 807 uses the corresponding business of service identification described in the specified objects trigger.
With referring to Fig. 9, the embodiment of the present invention additionally provides a kind of Service Process Server, it may include:
Input unit 901, output device 902, memory 903 and the (processor in Service Process Server of processor 904
Quantity can be one or more, in Fig. 9 by taking a processor as an example) in some embodiments of the invention, input unit
901, output device 902, memory 903 and processor 904 can be connected by bus or other manner, wherein, by total in Fig. 9
As a example by line connection.
Wherein, the processor 904 performs following steps:
Fig. 9 is referred in input unit 901, the embodiment of the present invention additionally provides a kind of Service Process Server, it may include:
Input unit 901, output device 902, memory 903 and the (processor in Service Process Server of processor 904
Quantity can be one or more, in Fig. 9 by taking a processor as an example) in some embodiments of the invention, input unit
901, output device 902, memory 903 and processor 904 can be connected by bus or other manner, wherein, by total in Fig. 9
As a example by line connection.
Wherein, the processor 904 performs following steps:
After input unit 901 receives the service trigger request that user terminal sends, processor 904 is according to contents extraction
Tactful and described extracting object content in the corresponding target video of the media identification of specified object time;Specified according to described
Object information determines to specify object;Obtain the service identification that the user terminal sends;Using described in the specified objects trigger
The corresponding business of service identification.
Output device 902 is returned after the contents of object to the user terminal so that the user terminal is according to institute
Contents of object is stated to determine to specify object information;Input unit 901 receives the second service trigger request that the user terminal sends.
Wherein, the content of the storage of memory 903 includes:
The service trigger request includes:Media identification, service identification and specified object time;
Optionally, the service trigger request also includes:Specify object information;
The specified object information includes:Specify object area information, or specified object characteristic attribute;
Optionally, the contents extraction strategy includes:
A two field picture is extracted at the described specified object time of the target video;
Or, before or after the described specified object time of the target video some durations, extract an at least frame figure
Picture;
Or, a period of time before and after the described specified object time of the target video is interval interior, an at least frame is extracted
Image;
Or, in some durations before or after the described specified object time of the target video, extracting one section of sound
Frequently;
Or, a period of time before and after the described specified object time of the target video is interval interior, a section audio is extracted;
Or, extracting captions at the described specified object time of the target video;
Or, in some durations before or after the described specified object time of the target video, extracting one section of word
Curtain;
Or, a period of time before and after the described specified object time of the target video is interval interior, one section of captions is extracted.
The embodiment to the transaction processing system of the present invention for performing above-mentioned service trigger method is illustrated below, its
Logical construction refer to Figure 10, and the transaction processing system one embodiment in the embodiment of the present invention includes:
User terminal 1001 and Service Process Server 1002;
The service generation service trigger request that the user terminal 1001 is triggered the need for being used to be selected according to user, and to
The Service Process Server sends the service trigger request, and the service trigger request includes:Media identification, service identification
With the specified object time;
The Service Process Server 1002 is used to receive the service trigger request of user terminal transmission, according to contents extraction
The tactful and described specified object time carries out media content extraction to the corresponding target video of the media identification;It is determined that specifying right
Image information;Specified object is determined in the media content according to the specified object information;Use the specified objects trigger
The corresponding business of the service identification.
The embodiment to the transaction processing system of the present invention for performing above-mentioned service trigger method is illustrated below, together
With reference to Figure 10, transaction processing system another embodiment in the embodiment of the present invention includes:
User terminal 1001 and Service Process Server 1002;
The user terminal 1001 is used to generate the first service trigger request, and sends institute to the Service Process Server
The first service trigger request is stated, first service trigger request includes:Media identification and specified object time;Receive the industry
Business processing server returns to the result that the contents of object is extracted so that the user terminal is extracted according to the media content
Result determines to specify object information;The second service trigger request is sent to Service Process Server, the second business triggering please
Ask including:Specify object information;
The Service Process Server 1002 is used to receive the first service trigger request of user terminal transmission, according to content
Extract the tactful and described specified object time carries out contents of object extraction to the corresponding target video of the media identification;To described
User terminal returns to the result that the contents of object is extracted, and the second service trigger request that user terminal sends is received, according to institute
Specified object information is stated to determine to specify object;Obtain the service identification that user terminal sends;Use the specified objects trigger institute
State the corresponding business of service identification.
The specific operation process of user terminal 1001 and Service Process Server 1002 please join in above-mentioned transaction processing system
Embodiment of the method is read, here is omitted.
In several embodiments provided herein, it should be understood that disclosed apparatus and method can be by it
Its mode is realized.For example, device embodiment described above is only schematical, for example, the division of the unit, only
Only a kind of division of logic function, can there is other dividing mode when actually realizing, such as multiple units or component can be tied
Another system is closed or is desirably integrated into, or some features can be ignored, or do not perform.It is another, it is shown or discussed
Coupling each other or direct-coupling or communication connection can be the INDIRECT COUPLINGs or logical of device or unit by some interfaces
Letter connection, can be electrical, mechanical or other forms.
The unit that is illustrated as separating component can be or may not be it is physically separate, it is aobvious as unit
The part for showing can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be according to the actual needs selected to realize the mesh of this embodiment scheme
's.
In addition, during each functional unit in each embodiment of the invention can be integrated in a processing unit, it is also possible to
It is that unit is individually physically present, it is also possible to which two or more units are integrated in a unit.Above-mentioned integrated list
Unit can both be realized in the form of hardware, it would however also be possible to employ the form of SFU software functional unit is realized.
If the integrated unit is to realize in the form of SFU software functional unit and as independent production marketing or use
When, can store in a computer read/write memory medium.Based on such understanding, technical scheme is substantially
The part for being contributed to prior art in other words or all or part of the technical scheme can be in the form of software products
Embody, the computer software product is stored in a storage medium, including some instructions are used to so that a computer
Equipment (can be personal computer, server, or network equipment etc.) performs the complete of each embodiment methods described of the invention
Portion or part steps.And foregoing storage medium includes:USB flash disk, mobile hard disk, read-only storage (ROM, Read-Only
Memory), random access memory (RAM, RandomAccess Memory), magnetic disc or CD etc. are various can store journey
The medium of sequence code.
The above, specific embodiment only of the invention, but protection scope of the present invention is not limited thereto, and it is any
Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all contain
Cover within protection scope of the present invention.Therefore, protection scope of the present invention described should be defined by scope of the claims.
Claims (27)
1. a kind of service trigger method, it is characterised in that including:
The service trigger request that user terminal sends is received, the service trigger request includes:Media identification, service identification and refers to
Determine the object time;
Media are extracted in the corresponding target video of the media identification according to contents extraction strategy and the specified object time
Content;
It is determined that specifying object information;
Specified object is determined in the media content according to the specified object information;
Use the corresponding business of service identification described in the specified objects trigger;
The service trigger request also includes:Specify object information;
It is described to determine that specified object information includes:The specified object information is extracted in the service trigger request;
It is described to be extracted in the corresponding target video of the media identification with the specified object time according to contents extraction strategy
Before media content, including:
According to the service identification in the first business contents extraction plan corresponding with the service identification is inquired about in tactful relation table
Slightly;
Or, according to the specified object information in object content corresponding with the specified object information is inquired about in tactful relation table
Extract strategy;
Or, the strategy mark carried in obtaining the service trigger request;According to the strategy mark selection target video
Contents extraction strategy.
2. method according to claim 1, it is characterised in that it is described according to contents extraction strategy and the specified object when
Between extract media content in the corresponding target video of the media identification before, including:
According to the service identification in the first business contents extraction plan corresponding with the service identification is inquired about in tactful relation table
Slightly;
Accordingly, it is described to determine that specified object information includes:
Determined to specify object information according to the contents extraction strategy.
3. the method according to claim 1 to 2 any one, it is characterised in that the specified object information includes:Specify
The area information of object;
If the specified object information be specify object area information, it is described according to the specified object information described
Determine to specify object in media content, including:
The media content is converted into characteristic, the characteristic includes:Matrix, each vector is represented in the matrix
Each pixel of frame of video;Area information according to the specified object extracts the picture of target area in the characteristic
Used as specified object, the target area is the region specified by the area information to vegetarian refreshments.
4. the method according to claim 1 to 2 any one, it is characterised in that the specified object information also includes:Refer to
Determine the characteristic attribute of object;
If the specified object information be specify object characteristic attribute, it is described according to the specified object information in the matchmaker
Determine to specify object in holding in vivo, including:
The media content is converted into characteristic, the characteristic includes:Matrix, each vector is represented in the matrix
Each pixel of frame of video;Extracted in the characteristic according to the specified characteristics of objects attribute and meet the feature category
The data message of property is used as specified object.
5. method according to claim 4, it is characterised in that
It is described the media content is converted into characteristic after, specifically also include:
According to the media identification and the service identification in media data storage, can be touched in the acquisition target video
The characteristic for sending out the corresponding business of service identification described, and the characteristic being converted to the media content compared
Compared with;
Under the scene that the specified object information is the area information for specifying object, if the calculating difference of two characteristics is small
In a threshold value, then trigger the basis and specify the area information of object that the pixel of target area is extracted in the characteristic
Point is used as specified object;
Under the scene that the specified object information is the characteristic attribute for specifying object, if the calculating difference of two characteristics is small
In a threshold value, then trigger to be extracted in the characteristic according to the specified characteristics of objects attribute and meet the characteristic attribute
Data message as specified object.
6. the method according to claim 1 to 2 any one, it is characterised in that described according to the specified object information
Before determining to specify object in the media content, including:
According to the service identification in the second business content analysis plan corresponding with the service identification is inquired about in tactful relation table
Slightly;
It is described to be determined in the media content to specify object according to the specified object information, including:
Determined to specify object in the media content according to the content analysis strategy and the specified object information.
7. the method according to claim 1 to 2 any one, it is characterised in that the contents extraction strategy includes:
A two field picture is extracted at the described specified object time of the target video;
Or, before or after the described specified object time of the target video some durations, extract an at least two field picture;
Or, a period of time before and after the described specified object time of the target video is interval interior, an at least two field picture is extracted;
Or, in some durations before or after the described specified object time of the target video, extracting a section audio;
Or, a period of time before and after the described specified object time of the target video is interval interior, a section audio is extracted;
Or, extracting captions at the described specified object time of the target video;
Or, in some durations before or after the described specified object time of the target video, extracting one section of captions;
Or, a period of time before and after the described specified object time of the target video is interval interior, one section of captions is extracted.
8. a kind of service trigger method, it is characterised in that including:
The first service trigger request that user terminal sends is received, first service trigger request includes media identification and specifies
The object time;
The extracting object in the corresponding target video of the media identification according to contents extraction strategy and the specified object time
Content;
The contents of object is returned to the user terminal so that the user terminal determines to specify right according to the contents of object
Image information;
The second service trigger request that the user terminal sends is received, second service trigger request includes:Specify object
Information;
Determine to specify object according to the specified object information;
Obtain the service identification that the user terminal sends;
Use the corresponding business of service identification described in the specified objects trigger;
It is described to be extracted in the corresponding target video of the media identification with the specified object time according to contents extraction strategy
Before contents of object, including:
According to the service identification in the first business contents extraction plan corresponding with the service identification is inquired about in tactful relation table
Slightly;
Or, according to the contents extraction strategy of the strategy mark selection target video;
Or, determining the contents extraction strategy of the target video according to the extraction duration information.
9. method according to claim 8, it is characterised in that first service trigger request also includes:Service identification;
Accordingly, the service identification for obtaining user terminal transmission, including:
The service identification is obtained in first service trigger request.
10. method according to claim 8, it is characterised in that second service trigger request also includes:Business mark
Know;
Accordingly, the service identification for obtaining user terminal transmission, including:
The service identification is obtained in second service trigger request.
11. method according to claim 8 to 10 any one, it is characterised in that it is described according to contents extraction strategy and
Extracting object content in the corresponding target video of the media identification of the specified object time, specifically includes:
An at least two field picture is extracted in the target video according to the specified object time;
The contents of object appeared in an at least two field picture is extracted respectively according to different characteristic attributes, is wrapped
To be selected specified object group containing multiple contents of object.
12. method according to claim 8 to 10 any one, it is characterised in that the service trigger request also includes:
Strategy mark;
Accordingly, it is described according to contents extraction strategy and the specified object time is in the corresponding target video of the media identification
Before middle extracting object content, including:
According to the contents extraction strategy of the strategy mark selection target video.
13. method according to claim 8 to 10 any one, it is characterised in that the contents extraction strategy includes:
A two field picture is extracted at the described specified object time of the target video;
Or, before or after the described specified object time of the target video some durations, extract an at least two field picture;
Or, a period of time before and after the described specified object time of the target video is interval interior, an at least two field picture is extracted.
A kind of 14. Service Process Server, it is characterised in that including:
Receiving unit, the service trigger request for receiving user terminal transmission, the service trigger request includes:Media mark
Knowledge, service identification and specified object time;
Extraction unit, for being regarded in the corresponding target of the media identification according to contents extraction strategy and the specified object time
Media content is extracted in frequency;
Object determining unit, it is true in the media content according to the specified object information for determining to specify object information
Surely object is specified;
Service trigger unit, for using the corresponding business of service identification described in the specified objects trigger;
The service trigger request also includes:Specify object information;
The object determining unit specifically for:The specified object information is extracted in the service trigger request;
The Service Process Server also includes:
Policy determining unit is extracted, for inquiring about the business in the first business with tactful relation table according to the service identification
Identify corresponding contents extraction strategy;Or, inquiring about the finger in object with tactful relation table according to the specified object information
Determine the corresponding contents extraction strategy of object information;Or, the strategy mark carried in obtaining the service trigger request;According to described
The contents extraction strategy of the strategy mark selection target video.
15. Service Process Server according to claim 14, it is characterised in that the object determining unit is specifically used
In:According to the service identification in the first business contents extraction plan corresponding with the service identification is inquired about in tactful relation table
Slightly;Determined to specify object information according to the contents extraction strategy.
16. Service Process Server according to claim 14 to 15 any one, it is characterised in that the specified object
Information includes:Specify the area information of object;
The object determining unit specifically for:If the specified object information is the area information for specifying object, will be described
Media content is converted to characteristic, and the characteristic includes:Matrix, each vector represents the every of frame of video in the matrix
One pixel;Area information according to the specified object extracts the pixel of target area as finger in the characteristic
Determine object, the target area is the region specified by the area information.
17. Service Process Server according to claim 14 to 15 any one, it is characterised in that the specified object
Information includes:Specify the characteristic attribute of object;
The object determining unit is specifically additionally operable to:If the specified object information is the characteristic attribute for specifying object, by institute
State media content and be converted to characteristic, the characteristic includes:Matrix, each vector represents frame of video in the matrix
Each pixel;The data for meeting the characteristic attribute are extracted in the characteristic according to the specified characteristics of objects attribute
Information is used as specified object.
18. Service Process Server according to claims 14 or 15, it is characterised in that the object determining unit is specific
It is additionally operable to:After the media content is converted into characteristic, according to the media identification and the service identification in media
In data storage, the characteristic that the corresponding business of the service identification can be triggered in the target video is obtained, and with
The characteristic that the media content is converted to is compared;It is the area information for specifying object in the specified object information
Scene under, if two calculating differences of characteristic are less than a threshold value, trigger the region letter that the basis specifies object
Cease and the pixel of target area is extracted in the characteristic as specified object;It is right to specify in the specified object information
Under the scene of the characteristic attribute of elephant, if two calculating differences of characteristic are less than a threshold value, trigger and specified according to described
Characteristics of objects attribute extracts the data message for meeting the characteristic attribute as specified object in the characteristic.
19. Service Process Server according to claim 14 to 15 any one, it is characterised in that the Business Processing
Server also includes:
Analysis strategy determining unit, for inquiring about the business in the second business with tactful relation table according to the service identification
Identify corresponding content analysis strategy.
20. Service Process Server according to claim 14 to 15 any one, it is characterised in that the contents extraction
Strategy includes:
A two field picture is extracted at the described specified object time of the target video;
Or, before or after the described specified object time of the target video some durations, extract an at least two field picture;
Or, a period of time before and after the described specified object time of the target video is interval interior, an at least two field picture is extracted;
Or, in some durations before or after the described specified object time of the target video, extracting a section audio;
Or, a period of time before and after the described specified object time of the target video is interval interior, a section audio is extracted;
Or, extracting captions at the described specified object time of the target video;
Or, in some durations before or after the described specified object time of the target video, extracting one section of captions;
Or, a period of time before and after the described specified object time of the target video is interval interior, one section of captions is extracted.
A kind of 21. Service Process Server, it is characterised in that including:
First receiving unit, the first service trigger request for receiving user terminal transmission, first service trigger request
Including:Media identification and specified object time;
Contents extracting unit, for according to contents extraction strategy and the specified object time in the corresponding mesh of the media identification
Extracting object content in mark video;
Information feedback unit, for returning to the contents of object to the user terminal so that the user terminal is according to
Contents of object determines to specify object information;
Second receiving unit, for receiving the second service trigger request that the user terminal sends, the second business triggering
Request includes:Specify object information;
Object determining unit, for determining to specify object according to the specified object information;
Mark acquiring unit, for obtaining the service identification that the user terminal sends;
Service trigger unit, for using the corresponding business of service identification described in the specified objects trigger;
Wherein, the Service Process Server is additionally operable to be inquired about in the first business with tactful relation table according to the service identification
The corresponding contents extraction strategy of the service identification;Or, according to the contents extraction of the strategy mark selection target video
Strategy;Or, determining the contents extraction strategy of the target video according to the extraction duration information.
22. Service Process Server according to claim 21, it is characterised in that the mark acquiring unit is specifically used
In:The service identification is obtained in first service trigger request, or, obtaining institute in second service trigger request
State service identification.
23. Service Process Server according to claim 21 or 22, it is characterised in that the contents extracting unit is specific
For:An at least two field picture is extracted in the target video according to the specified object time;According to different characteristic attributes
The contents of object appeared in an at least two field picture is extracted respectively, obtains treating comprising multiple contents of object
Object group is specified in choosing.
24. Service Process Server according to claim 21 to 22 any one, it is characterised in that the business triggering
Request also includes:Strategy mark;
The Service Process Server also includes:
Policy determining unit, for the contents extraction strategy according to the strategy mark selection target video.
25. Service Process Server according to claim 21 to 22 any one, it is characterised in that the contents extraction
Strategy includes:
A two field picture is extracted at the described specified object time of the target video;
Or, before or after the described specified object time of the target video some durations, extract an at least two field picture;
Or, a period of time before and after the described specified object time of the target video is interval interior, an at least two field picture is extracted.
A kind of 26. transaction processing systems, it is characterised in that including:
User terminal and Service Process Server;
The service generation service trigger request that the user terminal is triggered the need for being used to be selected according to user, and to the business
Processing server sends the service trigger request, and the service trigger request includes:Media identification, service identification is right with specified
As the time;
The Service Process Server is used to receive the service trigger request of user terminal transmission, according to contents extraction strategy and institute
State the specified object time and extract media content in the corresponding target video of the media identification;It is determined that specifying object information;Root
Specified object is determined in the media content according to the specified object information;Use business mark described in the specified objects trigger
Know corresponding business;
The service trigger request also includes:Specify object information;
It is described to determine that specified object information includes:The specified object information is extracted in the service trigger request;
It is described to be extracted in the corresponding target video of the media identification with the specified object time according to contents extraction strategy
Before media content, including:
According to the service identification in the first business contents extraction plan corresponding with the service identification is inquired about in tactful relation table
Slightly;
Or, according to the specified object information in object content corresponding with the specified object information is inquired about in tactful relation table
Extract strategy;
Or, the strategy mark carried in obtaining the service trigger request;According to the strategy mark selection target video
Contents extraction strategy.
A kind of 27. transaction processing systems, it is characterised in that including:
User terminal and Service Process Server;
The user terminal is used to generate the first service trigger request, and sends first industry to the Service Process Server
Business trigger request, first service trigger request includes:Media identification and specified object time;Receive the Business Processing clothes
Business device returns to the contents of object so that the user terminal determines to specify object information according to the contents of object;To business
Processing server sends the second service trigger request, and second service trigger request includes:Specify object information;
The Service Process Server is used to receive the first service trigger request of user terminal transmission, according to contents extraction strategy
With the specified object time in the corresponding target video of the media identification extracting object content;Returned to the user terminal
The contents of object is returned, the second service trigger request that user terminal sends is received, determines to refer to according to the specified object information
Determine object;Obtain the service identification that user terminal sends;Use the corresponding business of service identification described in the specified objects trigger;
It is described to be extracted in the corresponding target video of the media identification with the specified object time according to contents extraction strategy
Before contents of object, including:
According to the service identification in the first business contents extraction plan corresponding with the service identification is inquired about in tactful relation table
Slightly;
Or, according to the contents extraction strategy of the strategy mark selection target video;
Or, determining the contents extraction strategy of the target video according to the extraction duration information.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310447296.7A CN103533383B (en) | 2013-09-26 | 2013-09-26 | A kind of service trigger method, apparatus and system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310447296.7A CN103533383B (en) | 2013-09-26 | 2013-09-26 | A kind of service trigger method, apparatus and system |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103533383A CN103533383A (en) | 2014-01-22 |
CN103533383B true CN103533383B (en) | 2017-06-13 |
Family
ID=49934992
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201310447296.7A Active CN103533383B (en) | 2013-09-26 | 2013-09-26 | A kind of service trigger method, apparatus and system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103533383B (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105373938A (en) | 2014-08-27 | 2016-03-02 | 阿里巴巴集团控股有限公司 | Method for identifying commodity in video image and displaying information, device and system |
CN104951971B (en) * | 2015-05-22 | 2018-12-04 | 腾讯科技(北京)有限公司 | information display system, method and device |
CN111988656A (en) * | 2020-07-28 | 2020-11-24 | 烽火通信科技股份有限公司 | Method and system for transmitting streaming media video user touch information |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7240075B1 (en) * | 2002-09-24 | 2007-07-03 | Exphand, Inc. | Interactive generating query related to telestrator data designating at least a portion of the still image frame and data identifying a user is generated from the user designating a selected region on the display screen, transmitting the query to the remote information system |
CN102349048A (en) * | 2009-03-11 | 2012-02-08 | 索尼公司 | Accessing item information for item selected from a displayed image |
CN102576365A (en) * | 2009-10-06 | 2012-07-11 | 高通股份有限公司 | Systems and methods for merchandising transactions via image matching in a content delivery system |
CN103294744A (en) * | 2012-01-09 | 2013-09-11 | 三星电子株式会社 | Display apparatus, remote control apparatus, and searching methods thereof |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102880634B (en) * | 2012-07-30 | 2016-07-20 | 成都西可科技有限公司 | Intelligent human-face recognition and retrieval method based on cloud |
-
2013
- 2013-09-26 CN CN201310447296.7A patent/CN103533383B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7240075B1 (en) * | 2002-09-24 | 2007-07-03 | Exphand, Inc. | Interactive generating query related to telestrator data designating at least a portion of the still image frame and data identifying a user is generated from the user designating a selected region on the display screen, transmitting the query to the remote information system |
CN102349048A (en) * | 2009-03-11 | 2012-02-08 | 索尼公司 | Accessing item information for item selected from a displayed image |
CN102576365A (en) * | 2009-10-06 | 2012-07-11 | 高通股份有限公司 | Systems and methods for merchandising transactions via image matching in a content delivery system |
CN103294744A (en) * | 2012-01-09 | 2013-09-11 | 三星电子株式会社 | Display apparatus, remote control apparatus, and searching methods thereof |
Also Published As
Publication number | Publication date |
---|---|
CN103533383A (en) | 2014-01-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103428069B (en) | Method and device for adding friends in social network | |
CN105530175B (en) | Message processing method, device and system | |
US11880442B2 (en) | Authentication of audio-based input signals | |
CN104516892B (en) | It is associated with dissemination method, system and the terminal of the user-generated content of rich media information | |
CN102831537B (en) | A kind of method and device obtaining network advertisement information | |
CN101198018B (en) | Method for implementing television advertisement service and advertisement server | |
CN102413361A (en) | Friend information sharing method and system based on intelligent television | |
US20160301638A1 (en) | Methods and devices for controlling machines | |
US20140325391A1 (en) | System and method for updating information in an instant messaging application | |
CN103716339A (en) | Multimedia sharing method, system and device | |
CN103368947A (en) | Media information control method, related equipment and system | |
CN105407365B (en) | A kind of ad data management method and advertising management service end | |
JP6410936B2 (en) | Method for providing communication service between mobile terminals using short-range wireless device | |
CN105519123A (en) | Live crowdsourced media streaming | |
CN101715104B (en) | Network interaction reading system and method for user and content management | |
CN106874460A (en) | Information recommendation method, apparatus and system | |
CN102098549A (en) | Electronic program guide (EPG) system for providing social network service | |
CN103533383B (en) | A kind of service trigger method, apparatus and system | |
CN103718529A (en) | Advertisement storage method, and advertisement insertion method, apparatus and system | |
CN104185040A (en) | Application synchronization method, application server and terminal | |
CN103812903A (en) | Method and system for achieving intelligent song requesting through Internet and service management server | |
CN113839913B (en) | Interactive information processing method, related device and storage medium | |
WO2014176896A1 (en) | System and method for updating information in an instant messaging application | |
CN104717131A (en) | Information interaction method and server | |
CN103368925A (en) | Device authentication method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20200211 Address after: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Patentee after: HUAWEI TECHNOLOGIES Co.,Ltd. Address before: 210012 HUAWEI Nanjing base, 101 software Avenue, Yuhuatai District, Jiangsu, Nanjing Patentee before: Huawei Technologies Co.,Ltd. |
|
TR01 | Transfer of patent right |