CN110213599A - A kind of method, equipment and the storage medium of additional information processing - Google Patents
A kind of method, equipment and the storage medium of additional information processing Download PDFInfo
- Publication number
- CN110213599A CN110213599A CN201910304629.8A CN201910304629A CN110213599A CN 110213599 A CN110213599 A CN 110213599A CN 201910304629 A CN201910304629 A CN 201910304629A CN 110213599 A CN110213599 A CN 110213599A
- Authority
- CN
- China
- Prior art keywords
- target
- frame
- additional information
- video
- video frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 230000010365 information processing Effects 0.000 title claims abstract description 25
- 238000003860 storage Methods 0.000 title claims description 36
- 238000012545 processing Methods 0.000 claims description 77
- 230000002123 temporal effect Effects 0.000 claims description 26
- 230000000153 supplemental effect Effects 0.000 claims description 5
- 238000003672 processing method Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 25
- 230000006870 function Effects 0.000 description 10
- 230000006854 communication Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 238000004590 computer program Methods 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 239000007787 solid Substances 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012905 input function Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000002860 competitive effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 239000000039 congener Substances 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
- H04N21/2355—Processing of additional data, e.g. scrambling of additional data or processing content descriptors involving reformatting operations of additional data, e.g. HTML pages
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
- H04N21/4355—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream involving reformatting operations of additional data, e.g. HTML pages on a television screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Security & Cryptography (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
This application discloses a kind of methods of additional information processing, comprising: obtains video flowing, the video flowing includes an at least frame video frame；It handles the video flowing and obtains an associated instructions of an at least target video frame and the corresponding target video frame；Target additional information corresponding with the associated instructions is searched according to the associated instructions, the target additional information is superimposed on the target video frame.The embodiment of the present application is directly superimposed relevant additional information when getting associated instructions, improves the acquisition speed of additional information.
Description
Technical field
This application involves technical field of video processing, and in particular to a kind of method, equipment and the storage of additional information processing
Medium.
Background technique
Currently usually can all it break for commercialsy before video program play, in broadcasting or after playing.Wherein, it is intercutted in broadcasting
Advertisement requires pause current video program, after broadcasting to be broadcast, is further continued for playing.
Breaking for commercialsy in video playing is the picture for being completely turned off video program, is directly entered advertisement picture, also has at present
It is a kind of do not need to be completely turned off during video program play video program picture can inquire it is related in video program
The advertising display mode of information.This kind of advertising display mode is during displaying video programs, if spectators are to inside video
Object it is interested, video can be suspended, then recall recognition mode, can provide at this time selection region of interest field prompt, spectators
Region is chosen, has " starting to identify " and the " Cancel " button below the rectangle frame of region.Spectators click " starting to identify " button, and triggering will
The image of selected areas is uploaded to image recognition server, and image recognition server is analyzed using machine learning techniques intelligent recognition
The content of selected region picture returns to the object names that may include, correspondingly carries the interactive information of these possible objects,
Advertisement namely relevant to the object.
The mode for being currently inserted into advertisement in video program it can be seen from foregoing description needs to suspend video program, and
And multiple interactive operation is also needed, cause the efficiency of acquisition of information very low.
Summary of the invention
A kind of method that the embodiment of the present application provides additional information processing can be in video when getting associated instructions
It is directly superimposed relevant additional information on frame, improves the acquisition efficiency of additional information.The embodiment of the present application also provides corresponding
Equipment and storage medium.
The application first aspect provides a kind of method of additional information processing, comprising:
Video flowing is obtained, the video flowing includes an at least frame video frame；
It handles the video flowing and the association for obtaining an at least target video frame and the corresponding target video frame refers to
It enables；
Target additional information corresponding with the associated instructions is searched according to the associated instructions, in the target video frame
The upper superposition target additional information.
The application second aspect provides a kind of method of additional information processing, comprising:
Video processing equipment receives video flowing, and the video flowing includes an at least frame video frame；
The video processing equipment identifies the target video frame in the video flowing, is regarded with determining with the target
The associated target additional information of frequency frame, the target video frame are contained in an at least frame video frame；
The video processing equipment is that the target additional information configures association letter associated with the target video frame
Breath.
The application third aspect provides a kind of method of additional information processing, comprising:
Video reporting equipment determines the type of video frame in an at least frame video frame for video flowing to be sent；
When the video frame is key frame, the video reporting equipment is key frame configuration associated global one
Cause property temporal information；
The video reporting equipment sends the key frame and the global consistency temporal information, the whole world consistency
Temporal information is for determining that identification information, the identification information are used for associated objects video frame and target accessory information, the mesh
Mark video frame is contained in an at least frame video frame.
The application fourth aspect provides a kind of terminal, comprising:
Module is obtained, for obtaining video flowing, the video flowing includes an at least frame video frame；
First processing module, for handling the video flowing and obtaining an at least target video frame and the corresponding target
One associated instructions of video frame；
Second processing module, for searching the additional letter of target corresponding with the associated instructions according to the associated instructions
Breath, is superimposed the target additional information on the target video frame.
In conjunction with fourth aspect, in the first possible implementation,
The Second processing module, in the associated instructions being given birth to respond the clicking operation for target object
At instruction, when the target object is the object corresponding to the target video frame in content, the prominent target object,
And superposition and the associated target additional information of the target object in the content corresponding to the target video frame.
In conjunction with fourth aspect, in the second possible implementation,
The Second processing module responds content corresponding to the target video frame for being in the associated instructions
In particular event and generate instruction when, position corresponding to the particular event in the content corresponding to the target video frame
Set the superposition target additional information associated with the particular event.
In conjunction with fourth aspect, fourth aspect the first or second of possible implementation, in the third possible realization
In mode, the Second processing module includes:
First acquisition unit, for obtaining the target video frame and target additional information according to the associated instructions
Related information；
First searching unit, the related information for being obtained according to the first acquisition unit are searched from information distributing device
The target additional information corresponding with the target video frame；
First processing units, it is additional for being superimposed the target that first searching unit obtains on the target video frame
Information.
In conjunction with fourth aspect, fourth aspect the first or second of possible implementation, in the 4th kind of possible realization
In mode, the Second processing module includes:
Second acquisition unit, for obtaining the related information of the target video frame and target additional information；
Second searching unit, the related information for being obtained according to the second acquisition unit are searched from information distributing device
The target additional information corresponding with the target video frame；
The second processing unit, for being superimposed described second on the target video frame and searching according to the associated instructions
The target additional information that unit obtains.
In conjunction with fourth aspect the third or the 4th kind of possible implementation, in a fifth possible implementation,
The acquisition module is also used to obtain the timestamp of the target video frame as the related information, the mesh
The timestamp for marking additional information is identical as the timestamp of the target video frame.
In conjunction with fourth aspect the third or the 4th kind of possible implementation, in a sixth possible implementation,
The acquisition module is also used to according to the nearest key in the video flowing before the target video frame
The timestamp of the timestamp of frame, the target video frame, and global consistency temporal information associated with the key frame
Determine identification information, and using the identification information as the related information.
In conjunction with the 6th kind of possible implementation of fourth aspect, in the 7th kind of possible implementation, described global one
Cause property temporal information is located in the key frame or the global consistency temporal information is located at supplemental enhancement information SEI frame
In, the SEI is after the key frame and close to the key frame.
The 5th aspect of the application provides a kind of video processing equipment, comprising:
Receiving module, for receiving video flowing, the video flowing includes an at least frame video frame；
Determining module, for being identified to the target video frame in the video flowing, with the determining and target video
The associated target additional information of frame, the target video frame are contained in the received at least frame video of the receiving module
Frame；
Configuration module, the target additional information configuration for determining for the determining module are related to the target video frame
The related information of connection.
In conjunction with the 5th aspect, in the first possible implementation,
The configuration module is related to the target additional information for configuring the timestamp of the target video frame to
The related information of connection.
In conjunction with the 5th aspect, in the second possible implementation,
The configuration module, for according to the nearest key frame in the video flowing before the target video frame
Timestamp, the target video frame timestamp, and global consistency temporal information associated with the key frame is true
Determine identification information；The related information associated with the target additional information is configured by the identification information.
In conjunction with the 5th aspect, the 5th aspect the first or second of possible implementation, in the third possible realization
In mode, the video processing equipment further include:
Sending module, for sending the related information and the target additional information to information distributing device.
The 6th aspect of the application provides a kind of video reporting equipment, comprising:
Determining module, for determining the type of every frame video frame in video flowing to be sent；
Configuration module, for when the determining module determine to video frame be key frame when, for the key frame configure phase
Associated whole world consistency temporal information；
Sending module, for sending the global consistency temporal information of the key frame and configuration module configuration, institute
Global consistency temporal information is stated for determining that identification information, the identification information are used for associated objects video frame and target attachment
Information, the target video frame are contained in an at least frame video frame.
The 7th aspect of the application provides a kind of terminal, and the terminal includes processor and memory:
For the memory for storing program instruction, the processor is as above to execute for running described program instruction
The method for stating the processing of additional information described in first aspect.
The application eighth aspect provides a kind of video processing equipment, and the video processing equipment includes processor and storage
Device:
For the memory for storing program instruction, the processor is as above to execute for running described program instruction
The method for stating the processing of additional information described in second aspect.
The 9th aspect of the application provides a kind of video reporting equipment, and the video reporting equipment includes processor and storage
Device:
For the memory for storing program instruction, the processor is as above to execute for running described program instruction
The method for stating the processing of additional information described in the third aspect.
Above-mentioned terminal, video processing equipment and video reporting equipment can be computer equipment.
The another aspect of the application provides a kind of computer readable storage medium, in the computer readable storage medium
It is stored with instruction, when run on a computer, so that computer executes method described in above-mentioned first aspect.
The another aspect of the application provides a kind of computer readable storage medium, in the computer readable storage medium
It is stored with instruction, when run on a computer, so that computer executes method described in above-mentioned second aspect.
The another aspect of the application provides a kind of computer readable storage medium, in the computer readable storage medium
It is stored with instruction, when run on a computer, so that computer executes method described in the above-mentioned third aspect.
The another aspect of the application provides a kind of computer program product comprising instruction, when it runs on computers
When, so that computer executes method described in above-mentioned various aspects.
The embodiment of the present application gets associated instructions when handling video flowing, is then directly superimposed correlation according to associated instructions
Additional information, additional information establishes in advance with being associated with for video frame, do not need to carry out video analysis again, to improve
The acquisition efficiency of additional information.
Detailed description of the invention
Fig. 1 is a Sample Scenario schematic diagram of additional information processing system in the embodiment of the present application；
Fig. 2A is a schematic diagram for showing interface in the embodiment of the present application；
Fig. 2 B is a schematic diagram for showing interface in the embodiment of the present application；
Fig. 2 C is a schematic diagram for showing interface in the embodiment of the present application；
Fig. 2 D is a schematic diagram for showing interface in the embodiment of the present application；
Fig. 3 is another schematic diagram for showing interface in the embodiment of the present application；
Fig. 4 is an example schematic diagram of additional information in the embodiment of the present application；
Fig. 5 is an example schematic diagram of content corresponding to video frame in the embodiment of the present application；
Fig. 6 is another Sample Scenario schematic diagram of additional information processing system in the embodiment of the present application；
Fig. 7 is a Sample Scenario schematic diagram of the method that additional information is handled in the embodiment of the present application；
Fig. 8 is an embodiment schematic diagram of terminal in the embodiment of the present application；
Fig. 9 is another embodiment schematic diagram of terminal in the embodiment of the present application；
Figure 10 is another embodiment schematic diagram of terminal in the embodiment of the present application；
Figure 11 is an embodiment schematic diagram of video processing equipment in the embodiment of the present application；
Figure 12 is an embodiment schematic diagram of video reporting equipment in the embodiment of the present application；
Figure 13 is another embodiment schematic diagram of terminal in the embodiment of the present application；
Figure 14 is an embodiment schematic diagram of server in the embodiment of the present application.
Specific embodiment
With reference to the accompanying drawing, embodiments herein is described, it is clear that described embodiment is only the application
The embodiment of a part, instead of all the embodiments.Those of ordinary skill in the art are it is found that with the development of technology and new field
The appearance of scape, technical solution provided by the embodiments of the present application are equally applicable for similar technical problem.
The description and claims of this application and term " first " in above-mentioned attached drawing, " second " etc. are for distinguishing
Similar object, without being used to describe a particular order or precedence order.It should be understood that the data used in this way are in appropriate feelings
It can be interchanged under condition, so that the embodiments described herein can be real with the sequence other than the content for illustrating or describing herein
It applies.In addition, term " includes " and " having " and their any deformation, it is intended that cover it is non-exclusive include, for example, packet
The process, method, system, product or equipment for having contained a series of steps or units those of be not necessarily limited to be clearly listed step or
Unit, but may include other steps being not clearly listed or intrinsic for these process, methods, product or equipment or
Unit.
The embodiment of the present application provides a kind of method of additional information processing, when getting associated instructions, directly superposition exhibition
Show relevant additional information, improves the displaying speed of additional information.The embodiment of the present application also provides corresponding equipment and deposit
Storage media.It is described in detail separately below.
The scheme of additional information processing provided by the embodiments of the present application can be applied in live streaming or program request, the live streaming or point
The content broadcast can be the video programs such as movie or television play, be also possible to the programme televised live of main broadcaster chatroom.It ties separately below
Fig. 1 and Fig. 2A is closed applicable under different scenes of the embodiment of the present application is introduced.
Fig. 1 is a Sample Scenario schematic diagram of additional information processing system in the embodiment of the present application.
As shown in Figure 1, additional information processing system provided by the embodiments of the present application may include: video reporting equipment 10A,
Video processing equipment 20, information distributing device 30, terminal 40A, terminal 40B and terminal 40C.Certainly, above-mentioned terminal 40A, terminal
40B and terminal 40C are merely illustrative, and any terminal that can play video is suitable for the scheme of the application, nor
The quantity of terminal in above-mentioned Fig. 1 should be not understood as to the restriction to terminal quantity.
Video reporting equipment 10A in scene Fig. 1 can be the server for storing video content, such as: storage electricity
Depending on the server of play, film, variety show or game shows etc..
Video processing equipment 20 can be the computer equipment with video content recognition function.
Information distributing device 30 can be storage equipment, can be in content distributing network (content delivery
Network, CDN) in realize.
Video reporting equipment 10A sends video flowing to video processing equipment 20, which includes an at least frame video frame.
An actually video flowing can be understood as a sequence of frames of video, include multi-frame video frame in the sequence of frames of video.One
In a embodiment, video frame includes the frame of the types such as I frame, P frame and B frame, wherein I frame is key frame, is regarded comprising a complete frame
Frequency information, P frame are forward reference frames, and when P frame decoding will just be able to achieve decoding with reference to corresponding I frame, and B frame is bi-directionally referenced
Frame will just be able to achieve decoding with reference to two frames of forward and backward when B frame decoding.
After video processing equipment 20 receives video flowing, the video frame in decoded video streams is understood, video processing equipment 20 decodes
When video frame, it can be every frame and all decode, then all carry out image recognition for every frame, determination should after identifying the content of image
The additional information of frame, it is also not necessary to all carry out identifying processing to every frame.Because the duplicate probability of the content of consecutive frame is big, institute
One frame of identification per second can be taken, such as: it is calculated by frame per second 30 namely every 30 frame identifies that a frame forms information flow, anyway,
Only parameter, this application do not distinguish this information flow sampling granularity, wherein identified video frame be properly termed as by
Identify frame.
Video processing equipment 20 can be identified frame for every frame and configure corresponding additional information, if every frame in video flowing is all
Identification, then every frame video frame is all identified frame, if every 30 frame identification is primary, then every 30 frames as described in example
Identified frame is identified frame, such as: in the frame sequence that number is 0 to 30, if the video frame that number is 0 and number is 30 be by
Frame is identified, then configuring corresponding additional information, the video that number is 1 to 29 for the identified frame that number is 0 and number is 30
It is identical as the additional information of identified frame that number is 0 that the additional information of frame can consider.
It is relevant to content corresponding to identified frame to be identified the additional information of frame configuration.In one embodiment
In, for being identified content corresponding to frame and be content shown by Fig. 2A, additional information can be each object in Fig. 2A
Title, such as: knapsack (backpack), people (person), truck (truck), car (car) and motorcycle
(motorbike).Certainly, additional information herein is only illustrated, which can configure according to the demand of business, such as:
The information of the knapsack comprising knapsack size, color, price and other congener styles can be configured for the knapsack.
Equally, car, motorcycle, people are worn clothes, shoes etc. can be configured similarly to the additional information of knapsack.Additional information
Display location be also not necessarily limited to mode shown by Fig. 2A, the display location of additional information can be it is diversified, such as Fig. 2 B institute
Show, can be shown below image in the form of horse race lamp, as shown in Figure 2 C, can be shown on the image in the form of barrage,
As shown in Figure 2 D, it can be shown in the form of a list on the right side of image, certainly, the displaying shape of the additional information of Fig. 2A to Fig. 2 D
Formula is all citing, is not construed to the restriction to additional information display form.In another embodiment, it is configured
Additional information is also not necessarily limited to above-mentioned advertisement category information.Such as: in competitive sports, as shown in figure 3, by taking football as an example, for into
Ball event can be goal event configuration cheer information, such as: the picture of applause or the sound of cheer.Such as: in gaming, double
Fang Zhandou can also configure the picture of applause or the sound of cheer if there is the event for hitting other side.Certainly, these types is all
Citing, additional information are also possible to other kinds of information.
Video processing equipment 20 be identified video frame configuration additional information after, information can be sent by additional information
Discharge device 30 is stored, and certain scene shown in figure 1 is a kind of implementation, in fact, the additional information
It can store on video processing equipment 20.In the following, being still illustrated for being stored on information distributing device 30.
Terminal 40A, terminal 40B or terminal 40C are when watching TV programme, available above-mentioned video flowing, and pass through
Content in video frame is rendered on screen by the operations such as decoding, rendering to be shown, is obtained when being shown to the content of a certain video frame
Associated instructions are got, then a certain video frame is just the target video frame in the embodiment of the present application, which is contained in
An at least frame video frame.
The producing method of associated instructions can there are many, can be and generated by user's operation, be also possible to terminal and pass through
To what is produced after the content recognition of target video frame, it is introduced separately below by different embodiments:
In one embodiment, which can be user and is existed by modes such as remote controler, finger touch or mouses
It is selected on image content corresponding to the target video frame, as shown in Figure 2 A, if user has selected many objects on Fig. 2A,
Selected object is known as target object.Such as: knapsack (backpack), people (person), truck (truck), car (car)
With motorcycle (motorbike) etc., then can for it is every it is all prominent show, the prominent mode shown side as shown in Fig. 2A
Formula is prominent by way of being outlined to be shown, is also possible to other and is protruded exhibition method, such as: it is highlighted etc..Certainly, above-mentioned Fig. 2A
Be for example, may user can't disposably select it is so multipair as only exhibition can be protruded if user has only selected knapsack
Show knapsack, then can also be superimposed target additional information relevant to the knapsack on the prominent picture for showing knapsack.Such as: it is folded
Add content as shown in Figure 4.Certainly, content shown in Fig. 4 is only illustrated, and can also show other similar with this knapsack picture
The knapsack of style, the content specifically shown can be customized according to businessman's demand, in this regard, the embodiment of the present application is without limitation.
In another embodiment, which can be terminal 40A, terminal 40B or terminal 40C to respond the mesh
The instruction marking the particular event in content corresponding to video frame and generating.Picture as shown in Figure 5, terminal 40A, terminal 40B
Or terminal 40C gets the event of goal when being played to content corresponding to the target video frame, then the goal event meeting
Triggering generates associated instructions, and then terminal 40A, terminal 40B or terminal 40C can the acquisition of information distributing device 30 and the goal things
The associated target additional information of part.As that can be the goal event configuration described in above-mentioned 20 side of video processing equipment
The additional information that applause is cheered, then terminal 40A, terminal 40B or terminal 40C will obtain the additional letter of applause cheer
Breath, and be superimposed and show on the goal picture, the result of displaying can participate in Fig. 3 and be understood.
It is had been described in above-mentioned scene, needs to be superimposed displaying target additional information, terminal 40A, end after obtaining associated instructions
40B or terminal 40C is held to need to obtain target additional information, the opportunity that target additional information obtains from information distributing device 30
Can there are many, such as: can after terminal 40A, terminal 40B or terminal 40C get associated instructions, further according to association believe
Breath obtains target additional information from information distributing device 30, and then is overlapped.It is also possible to after decoding target video frame, just
Target additional information is obtained from information distributing device 30 according to related information, then getting after associated instructions that directly superposition shows should
Target additional information.Wherein, get obtained after associated instructions again target additional information scheme can reduce it is unnecessary attached
Add the acquisition of information, Internet resources can be saved.Another kind, the scheme for first obtaining additional information can faster obtain target
Additional information.
The scheme of additional information is first obtained when realizing because terminal 40A, terminal 40B or terminal 40C are from pulling to most
New video frame is to have the time difference of one section of player buffer area to the video frame is played, this time difference is above greatly 2
Second, the time for pulling additional information enough and parsing.Then, when video frame will render on the screen, if there is user's interaction
To the video frame information when, then cooperate the additional information of the video frame to interact.
It is described above and is obtained by target video frame and the related information of target additional information from information distributing device 30
Target additional information.
In some embodiments, which can be timestamp, and each video frame has a timestamp, the timestamp
It is the scramble time stamp (Encoding Time Stamp, ETS) when video reporting equipment encodes the video frame, device for processing streams
The 20 decoding video frames, which can decode, stabs the ETS, is then that the corresponding additional information of the video frame covers that upper this is identical according to the ETS
Timestamp.In this way, terminal 40A, terminal 40B or terminal 40C can be distributed by the ETS of the target video frame from information
Equipment 30 obtains corresponding target additional information.
In some embodiments, which can be identification information, because in the terminal of different clarity, encoding and decoding
Content involved by process is more complicated, such as: the terminal device that the difference clarity such as super clear, high definition and standard requires is decoded
Video frame may be different from, and when clarity requires lower, much video frames can may be all dropped, so, video processing is set
Standby 20 can be additional information configuration identifier information, because the relative time difference between two video frames be will not be because of fortuitous event
It is changed, so the identification information can be relative time difference and global consistency time according to two video frames
What information determined.
In one embodiment, during determining identification information, need video reporting equipment in the key of video flowing
Global consistency temporal information Tcur is inserted into frame.In another embodiment, it is inserted in the position of the adjacent next frame of key frame
Enter supplemental enhancement information (supplemental enhancement information, SEI) frame, is inserted into the SEI frame complete
Ball consistency temporal information Tcur.In this way, video processing equipment 20 is when for additional information configuration identifier information, so that it may according to
The ETS in current video frame that is presently processing and the in this prior timestamp of the nearest key frame before video frame
Tcur in ETS0 and SEI frame determines the identification information of the additional information are as follows: ID=Tcur+ETS-ETS0.In this way, when eventually
End 40A, terminal 40B or terminal 40C be played to additional information accessed when the current video frame mark can with for
ID=Tcur+ETS-ETS0.If being played to other video frames, the identification information of other video frames can be expressed as ID '=
Tcur’+ETS’-ETS0’。
In compression/de-compression or audio video synchronization operation, SEI frame can also keep and be not dropped.
Corresponding additional information accurately can be found from information distributing device 30 by identification information, it can be to avoid because of solution
Time difference caused by complex scene during code.
Above-mentioned Fig. 1 is that the scene by the server of offer video content as video reporting equipment can in main broadcaster's scene
To be the terminal of main broadcaster as video reporting equipment 10B.As shown in fig. 6, video flowing is uploaded to video by the terminal of main broadcaster
Equipment 20 is managed, meanwhile, in the scene, video flowing can also be uploaded to video storaging equipment 50 by video reporting equipment 10B, in terminal
40A, terminal 40B perhaps terminal 40C play video when by video storaging equipment 50 be terminal 40A, terminal 40B or terminal 40C
Video flowing is provided.Other processes in the scene are identical as content described in above-mentioned Fig. 1 to Fig. 5, can participate in above-mentioned
Appearance is understood that it is no longer repeated at this place.
Above embodiment described the applicable scenes of the embodiment of the present application, describe the embodiment of the present application with reference to the accompanying drawing and mention
The method of the additional information processing of confession.
Fig. 7 is an embodiment schematic diagram of the method for additional information processing in the embodiment of the present application.
As shown in fig. 7, an embodiment of the method for additional information processing provided by the embodiments of the present application includes:
701, video reporting equipment sends video flowing to device for processing streams.
The video flowing includes an at least frame video frame.
702, after device for processing streams receives video flowing, the target video frame in the video flowing is identified, with determination
With the associated target additional information of the target video frame.
The target video frame is contained in an at least frame video frame.
703, video processing equipment is that the target additional information configures association letter associated with the target video frame
Breath.
The related information can be disposed in the target additional information, can not also be configured in target additional information
In, the association of target additional information and related information between the two can be established by other means.
The related information can be timestamp, be also possible to identification information.
If timestamp, then the timestamp of the target video frame is configured to add with the target by video processing equipment
The associated related information of information.
If identification information, then:
Video processing equipment according to the nearest key frame in the video flowing before the target video frame when
Between stamp, the target video frame timestamp, and global consistency temporal information associated with the key frame determines mark
Know information；
The identification information is configured the pass associated with the target additional information by the video processing equipment
Join information.
704, video processing equipment sends the related information and the target additional information to information distributing device.
705, information distributing device stores the related information and the target additional information.
706, terminal receives video flowing from video reporting equipment or video storaging equipment.
707, video flowing described in terminal processes and an at least target video frame and the corresponding target video frame are obtained
One associated instructions.
The step gets associated instructions when can be terminal plays target video frame.
It is the instruction that response is generated for the clicking operation of target object, institute that the associated instructions, which can be the terminal,
Stating target object is the object in content corresponding to the target video frame.
It is the specific thing in content corresponding to the response target video frame that the associated instructions, which can be the terminal,
Part and the instruction generated.
708, terminal obtains target additional information.
Step 708 can be before step 707, can also be after step 707.
If step 708 before step 707, may is that
Terminal obtains the related information of the target video frame and target additional information；
The target corresponding with the target video frame is obtained from information distributing device according to the related information to add
Information.
If step 708 after step 707, may is that
Terminal obtains the related information of the target video frame and target additional information according to the associated instructions；
The target corresponding with the target video frame is obtained from information distributing device according to the related information to add
Information.
Wherein, if related information is timestamp, terminal obtains the timestamp of the target video frame as the association
Information, the timestamp of the target additional information are identical as the timestamp of the target video frame.
Wherein, if related information is identification information, according in the video flowing before the target video frame most
The timestamp of the timestamp of a nearly key frame, the target video frame, and the whole world associated with the key frame are consistent
Property temporal information determines identification information, and using the identification information as the related information.
709, superposition shows the target additional information in terminal content corresponding to the target video frame.
The step 709 may include:
The prominent target object, and superposition is closed with the target object in the content corresponding to the target video frame
The target additional information of connection.Alternatively,
The superposition of position corresponding to particular event in the content corresponding to the target video frame and the specific thing
The associated target additional information of part.
It can be prominent displaying target object in the step, and be superimposed exhibition in the content corresponding to the target video frame
Show and the associated target additional information of the target object.
Description as described in the embodiment corresponding to Fig. 7 can also participate in description corresponding to earlier figures 1 to Fig. 6 and be understood,
It is no longer repeated at this place.
Terminal, video processing equipment and video reporting equipment provided by the embodiments of the present application are introduced with reference to the accompanying drawing.
Fig. 8 is an embodiment schematic diagram of terminal 80 provided by the embodiments of the present application.
As shown in figure 8, terminal 80 provided by the embodiments of the present application may include:
Module 801 is obtained, for obtaining video flowing, the video flowing includes an at least frame video frame；
First processing module 802, for handling the video flowing and obtaining described in an at least target video frame and correspondence
One associated instructions of target video frame；
Second processing module 803, the associated instructions for being obtained according to the first processing module 802 are searched and the pass
Connection instructs corresponding target additional information, and the target additional information is superimposed on the target video frame.
Optionally, the Second processing module 803 responds the point for being directed to target object for being in the associated instructions
The instruction hitting operation and generating, when the target object is the object in content corresponding to the target video frame, prominent institute
Target object is stated, and is superimposed in the content corresponding to the target video frame attached with the associated target of the target object
Add information.
Optionally, the Second processing module 803 responds the target video frame institute for being in the associated instructions
Particular event in corresponding content and the particular event when instruction generated, in the content corresponding to the target video frame
Corresponding position is superimposed the target additional information associated with the particular event.
Optionally, as shown in figure 9, the Second processing module 803 includes:
First acquisition unit 8031, for obtaining the target video frame and the additional letter of target according to the associated instructions
The related information of breath；
First searching unit 8032, the related information for being obtained according to the first acquisition unit 8031 are distributed from information
Equipment searches the target additional information corresponding with the target video frame；
First processing units 8033, for being superimposed the acquisition of the first searching unit 8032 on the target video frame
Target additional information.
Optionally, as shown in Figure 10, the Second processing module 803 includes:
Second acquisition unit 8034, for obtaining the related information of the target video frame and target additional information；
Second searching unit 8035, the related information for being obtained according to the second acquisition unit 8034 are distributed from information
Equipment searches the target additional information corresponding with the target video frame；
The second processing unit 8036, for being superimposed described second on the target video frame according to the associated instructions
The target additional information that searching unit 8035 obtains.
Optionally, the acquisition module 801, the timestamp for being also used to obtain the target video frame are believed as the association
Breath, the timestamp of the target additional information are identical as the timestamp of the target video frame.
Optionally, the acquisition module 801, be also used to according in the video flowing before the target video frame
The timestamp of the timestamp of a nearest key frame, the target video frame, and associated with the key frame global one
Cause property temporal information determines identification information, and using the identification information as the related information.
The whole world consistency temporal information is located in the key frame or the global consistency temporal information is located at
In supplemental enhancement information SEI frame, the SEI is after the key frame and close to the key frame.
Figure 11 is an embodiment schematic diagram of video processing equipment 90 provided by the embodiments of the present application.
As shown in figure 11, an embodiment of video processing equipment 90 provided by the embodiments of the present application includes:
Receiving module 901, for receiving video flowing, the video flowing includes an at least frame video frame；
Determining module 902 is regarded with determining with the target for identifying to the target video frame in the video flowing
The associated target additional information of frequency frame, the target video frame are contained in the received at least frame of the receiving module 901
Video frame；
Configuration module 903, the configuration of target additional information and the target video for being determined for the determining module 902
The associated related information of frame.
Optionally, the configuration module 903, it is attached with the target for configuring the timestamp of the target video frame to
Add the associated related information of information.
Optionally, the configuration module 903, for according to nearest before the target video frame in the video flowing
The timestamp of the timestamp of one key frame, the target video frame, and global consistency associated with the key frame
Temporal information determines identification information；The association letter associated with the target additional information is configured by the identification information
Breath.
Optionally, the video processing equipment 90 further include:
Sending module 904, for sending the related information and the target additional information to information distributing device.
Figure 12 is an embodiment schematic diagram of video reporting equipment 100 provided by the embodiments of the present application.
Video reporting equipment 100 provided by the embodiments of the present application may include:
Determining module 1001, for determining the type of every frame video frame in video flowing to be sent；
Configuration module 1002, for being the key when the determining module 1001 determines that arriving video frame is key frame
The associated global consistency temporal information of frame configuration；
Sending module 1003, for sending the global consistency time of the key frame and the configuration of the configuration module 1002
Information, the whole world consistency temporal information for determining identification information, the identification information for associated objects video frame and
Target accessory information, the target video frame are contained in an at least frame video frame.
The embodiment of the present application also provides another terminals, as shown in figure 13, for ease of description, illustrate only and this Shen
Please the relevant part of embodiment, it is disclosed by specific technical details, please refer to the embodiment of the present application method part.The terminal can be with
Being includes mobile phone, tablet computer, personal digital assistant (full name in English: Personal Digital Assistant, English contracting
Write: PDA), point-of-sale terminal (full name in English: Point of Sales, english abbreviation: POS), any terminal such as vehicle-mounted computer set
It is standby, taking the terminal as an example:
Figure 13 shows the block diagram of the part-structure of mobile phone relevant to terminal provided by the embodiments of the present application.With reference to figure
13, mobile phone includes: radio frequency (full name in English: Radio Frequency, english abbreviation: RF) circuit 1110, memory 1120, defeated
Enter unit 1130, display unit 1140, sensor 1150, voicefrequency circuit 1160, Wireless Fidelity (full name in English: wireless
Fidelity, english abbreviation: WiFi) components such as module 1170, processor 1180 and power supply 1190.Those skilled in the art
It is appreciated that handset structure shown in Figure 13 does not constitute the restriction to mobile phone, it may include more more or fewer than illustrating
Component perhaps combines certain components or different component layouts.
It is specifically introduced below with reference to each component parts of the Figure 13 to mobile phone:
RF circuit 1110 can be used for receiving and sending messages or communication process in, signal sends and receivees, particularly, by base station
After downlink information receives, handled to processor 1180；In addition, the data for designing uplink are sent to base station.In general, RF circuit
1110 include but is not limited to antenna, at least one amplifier, transceiver, coupler, low-noise amplifier (full name in English: Low
Noise Amplifier, english abbreviation: LNA), duplexer etc..In addition, RF circuit 1110 can also by wireless communication with net
Network and other equipment communication.Any communication standard or agreement can be used in above-mentioned wireless communication, and including but not limited to the whole world is mobile
Communication system (full name in English: Global System of Mobile communication, english abbreviation: GSM), general point
Group wireless service (full name in English: General Packet Radio Service, GPRS), CDMA (full name in English: Code
Division Multiple Access, english abbreviation: CDMA), wideband code division multiple access (full name in English: Wideband Code
Division Multiple Access, english abbreviation: WCDMA), long term evolution (full name in English: Long Term
Evolution, english abbreviation: LTE), Email, short message service (full name in English: Short Messaging Service,
SMS) etc..
Memory 1120 can be used for storing software program and module, and processor 1180 is stored in memory by operation
1120 software program and module, thereby executing the various function application and data processing of mobile phone.Memory 1120 can be led
It to include storing program area and storage data area, wherein storing program area can be needed for storage program area, at least one function
Application program (such as sound-playing function, image player function etc.) etc.；Storage data area, which can be stored, uses institute according to mobile phone
Data (such as audio data, phone directory etc.) of creation etc..In addition, memory 1120 may include high random access storage
Device, can also include nonvolatile memory, and a for example, at least disk memory, flush memory device or other volatibility are solid
State memory device.
Input unit 1130 can be used for receiving the selection operation for target object in video of user's input, and generate
Key signals input related with the user setting of mobile phone and function control.Specifically, input unit 1130 may include touch surface
Plate 1131 and other input equipments 1132.Touch panel 1131, also referred to as touch screen collect user on it or nearby
Touch operation (for example user uses any suitable objects or attachment such as finger, stylus on touch panel 1131 or in touch-control
Operation near panel 1131), and corresponding attachment device is driven according to preset formula.Optionally, touch panel
1131 may include both touch detecting apparatus and touch controller.Wherein, the touch side of touch detecting apparatus detection user
Position, and touch operation bring signal is detected, transmit a signal to touch controller；Touch controller is from touch detecting apparatus
Touch information is received, and is converted into contact coordinate, then give processor 1180, and the life that processor 1180 is sent can be received
It enables and is executed.Furthermore, it is possible to realize touch-control using multiple types such as resistance-type, condenser type, infrared ray and surface acoustic waves
Panel 1131.In addition to touch panel 1131, input unit 1130 can also include other input equipments 1132.Specifically, other
Input equipment 1132 can include but is not limited to physical keyboard, function key (such as volume control button, switch key etc.), track
One of ball, mouse, operating stick etc. are a variety of.
Display unit 1140 can be used for video content corresponding to frame of display video.Display unit 1140 may include display surface
Plate 1141, optionally, can using liquid crystal display (full name in English: Liquid Crystal Display, english abbreviation:
LCD), the shapes such as Organic Light Emitting Diode (full name in English: Organic Light-Emitting Diode, english abbreviation: OLED)
Formula configures display panel 1141.Further, touch panel 1131 can cover display panel 1141, when touch panel 1131 is examined
After measuring touch operation on it or nearby, processor 1180 is sent to determine the type of touch event, is followed by subsequent processing device
1180 provide corresponding visual output according to the type of touch event on display panel 1141.Although in Figure 13, touch surface
Plate 1131 and display panel 1141 are the input and input function for realizing mobile phone as two independent components, but certain
In embodiment, can be integrated by touch panel 1131 and display panel 1141 and that realizes mobile phone output and input function.
Mobile phone may also include at least one sensor 1150, such as optical sensor, motion sensor and other sensors.
Specifically, optical sensor may include ambient light sensor and proximity sensor, wherein ambient light sensor can be according to ambient light
Light and shade adjust the brightness of display panel 1141, proximity sensor can close display panel when mobile phone is moved in one's ear
1141 and/or backlight.As a kind of motion sensor, accelerometer sensor can detect in all directions (generally three axis) and add
The size of speed can detect that size and the direction of gravity when static, can be used to identify application (such as the horizontal/vertical screen of mobile phone posture
Switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap) etc.；Also as mobile phone
The other sensors such as configurable gyroscope, barometer, hygrometer, thermometer, infrared sensor, details are not described herein.
Voicefrequency circuit 1160, loudspeaker 1161, microphone 1162 can provide the audio interface between user and mobile phone.Audio
Electric signal after the audio data received conversion can be transferred to loudspeaker 1161, be converted by loudspeaker 1161 by circuit 1160
For voice signal output；On the other hand, the voice signal of collection is converted to electric signal by microphone 1162, by voicefrequency circuit 1160
Audio data is converted to after reception, then by after the processing of audio data output processor 1180, through RF circuit 1110 to be sent to ratio
Such as another mobile phone, or audio data is exported to memory 1120 to be further processed.
WiFi belongs to short range wireless transmission technology, and mobile phone can help user's transceiver electronics postal by WiFi module 1170
Part, browsing webpage and access streaming video etc., it provides wireless broadband internet access for user.Although Figure 13 is shown
WiFi module 1170, but it is understood that, and it is not belonging to must be configured into for mobile phone, it can according to need do not changing completely
Become in the range of the essence of invention and omits.
Processor 1180 is the control centre of mobile phone, using the various pieces of various interfaces and connection whole mobile phone,
By running or execute the software program and/or module that are stored in memory 1120, and calls and be stored in memory 1120
Interior data execute the various functions and processing data of mobile phone, to carry out integral monitoring to mobile phone.Optionally, processor
1180 may include one or more processing units；Preferably, processor 1180 can integrate application processor and modulation /demodulation processing
Device, wherein the main processing operation system of application processor, user interface and application program etc., modem processor is mainly located
Reason wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 1180.
Mobile phone further includes the power supply 1190 (such as battery) powered to all parts, it is preferred that power supply can pass through power supply
Management system and processor 1180 are logically contiguous, to realize management charging, electric discharge and power consumption pipe by power-supply management system
The functions such as reason.
Although being not shown, mobile phone can also include camera, bluetooth module etc., and details are not described herein.
In the embodiment of the present application, the components such as processor 1180, display unit 1140 included by the terminal can execute
Terminal side corresponding step in above-mentioned Fig. 1 to 7.
Video processing equipment and video reporting equipment provided by the embodiments of the present application can participate in Figure 14 and be understood, Figure 14
It is a kind of structural schematic diagram of server provided by the embodiments of the present application, which can produce because configuration or performance are different
Raw bigger difference, may include one or more central processing units (central processing units, CPU)
1222 (for example, one or more processors) and memory 1232, one or more storage application programs 1242 or
The storage medium 1230 (such as one or more mass memory units) of data 1244.Wherein, memory 1232 and storage
Medium 1230 can be of short duration storage or persistent storage.Be stored in storage medium 1230 program may include one or one with
Upper module (diagram does not mark), each module may include to the series of instructions operation in server.Further, central
Processor 1222 can be set to communicate with storage medium 1230, and the system in storage medium 1230 is executed on server 1200
Column instruction operation.
Server 1200 can also include one or more power supplys 1226, one or more wired or wireless nets
Network interface 1250, one or more input/output interfaces 1258, and/or, one or more operating systems 1241, example
Such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM etc..
The step as performed by server can be based on server architecture shown in the Figure 14 in above-described embodiment.
Wherein, CPU 1222 is reported for executing video processing equipment or video in embodiment corresponding to above-mentioned Fig. 1 to Fig. 7
Corresponding steps performed by equipment.
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or any combination thereof real
It is existing.When implemented in software, it can entirely or partly realize in the form of a computer program product.
The computer program product includes one or more computer instructions.Load and execute on computers the meter
When calculation machine program instruction, entirely or partly generate according to process or function described in the embodiment of the present application.The computer can
To be general purpose computer, special purpose computer, computer network or other programmable devices.The computer instruction can be deposited
Storage in a computer-readable storage medium, or from a computer readable storage medium to another computer readable storage medium
Transmission, for example, the computer instruction can pass through wired (example from a web-site, computer, server or data center
Such as coaxial cable, optical fiber, Digital Subscriber Line (DSL)) or wireless (such as infrared, wireless, microwave) mode to another website
Website, computer, server or data center are transmitted.The computer readable storage medium can be computer and can deposit
Any usable medium of storage either includes that the data storages such as one or more usable mediums integrated server, data center are set
It is standby.The usable medium can be magnetic medium, (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or partly lead
Body medium (such as solid state hard disk Solid StateDisk (SSD)) etc..
Those of ordinary skill is understood that all or part of the steps in the various methods of above-described embodiment is can to pass through
Program is completed to instruct relevant hardware, which can be stored in a computer readable storage medium, storage medium can
To include: ROM, RAM, disk or CD etc..
The method, equipment and storage medium of a kind of processing of additional information provided by the embodiment of the present application are carried out above
It is discussed in detail, specific examples are used herein to illustrate the principle and implementation manner of the present application, above embodiments
Explanation be merely used to help understand the present processes and its core concept；At the same time, for those skilled in the art,
According to the thought of the application, there will be changes in the specific implementation manner and application range, in conclusion in this specification
Hold the limitation that should not be construed as to the application.
Claims (15)
1. a kind of method of additional information processing characterized by comprising
Video flowing is obtained, the video flowing includes an at least frame video frame；
It handles the video flowing and obtains an associated instructions of an at least target video frame and the corresponding target video frame；
Target additional information corresponding with the associated instructions is searched according to the associated instructions, is folded on the target video frame
Add the target additional information.
2. the method according to claim 1, wherein the associated instructions are to respond the point for being directed to target object
The instruction hitting operation and generating, the target object is the object in content corresponding to the target video frame, described in institute
It states and is superimposed the target additional information in content corresponding to target video frame, comprising:
The prominent target object, and be superimposed in the content corresponding to the target video frame associated with the target object
The target additional information.
3. the method according to claim 1, wherein the associated instructions are to respond the target video frame institute
Particular event in corresponding content and the instruction generated, in the content corresponding to the target video frame described in superposition
Target additional information, comprising:
The superposition of position corresponding to particular event in the content corresponding to the target video frame and the particular event phase
The associated target additional information.
4. method according to claim 1-3, which is characterized in that described according to associated instructions lookup and institute
The corresponding target additional information of associated instructions is stated, the target additional information is superimposed on the target video frame, comprising:
According to the associated instructions, the related information of the target video frame and target additional information is obtained；
The target additional information corresponding with the target video frame is searched from information distributing device according to the related information；
The target additional information is superimposed on the target video frame.
5. method according to claim 1-3, which is characterized in that described according to associated instructions lookup and institute
The corresponding target additional information of associated instructions is stated, the target additional information is superimposed on the target video frame, comprising:
Obtain the related information of the target video frame and target additional information；
The target additional information corresponding with the target video frame is searched from information distributing device according to the related information；
According to the associated instructions, the target additional information is superimposed on the target video frame.
6. method according to claim 4 or 5, which is characterized in that the method also includes:
The timestamp of the target video frame is obtained as the related information, the timestamp of the target additional information with it is described
The timestamp of target video frame is identical.
7. method according to claim 4 or 5, which is characterized in that the method also includes:
According to timestamp, the target video of the nearest key frame in the video flowing before the target video frame
The timestamp of frame, and global consistency temporal information associated with the key frame determine identification information, and by the mark
Information is known as the related information.
8. the method according to the description of claim 7 is characterized in that the whole world consistency temporal information is located at the key frame
In or the global consistency temporal information be located in supplemental enhancement information SEI frame, the SEI is after the key frame
And close to the key frame.
9. a kind of method of additional information processing characterized by comprising
Video processing equipment receives video flowing, and the video flowing includes an at least frame video frame；
The video processing equipment identifies the target video frame in the video flowing, with the determining and target video frame
Associated target additional information, the target video frame are contained in an at least frame video frame；
The video processing equipment is that the target additional information configures related information associated with the target video frame.
10. according to the method described in claim 9, it is characterized in that, the video processing equipment is the target additional information
Configure related information associated with the target video frame, comprising:
The video processing equipment configures the timestamp of the target video frame to associated with the target additional information
The related information.
11. according to the method described in claim 9, it is characterized in that, the video processing equipment is the target additional information
Configure related information associated with the target video frame, comprising:
The video processing equipment according to the nearest key frame in the video flowing before the target video frame when
Between stamp, the target video frame timestamp, and global consistency temporal information associated with the key frame determines mark
Know information；
The identification information is configured the association associated with the target additional information by the video processing equipment to be believed
Breath.
12. a kind of method of additional information processing characterized by comprising
Video reporting equipment determines the type of every frame video frame in video flowing to be sent；
When determining that arriving video frame is key frame, the video reporting equipment is that the key frame configures the associated whole world unanimously
Property temporal information；
The video reporting equipment sends the key frame and the global consistency temporal information, the whole world consistency time
Information is for determining that identification information, the identification information are used for associated objects video frame and target accessory information, the target view
Frequency frame is contained in an at least frame video frame.
13. a kind of terminal characterized by comprising
Module is obtained, for obtaining video flowing, the video flowing includes an at least frame video frame；
First processing module, for handling the video flowing and obtaining an at least target video frame and the corresponding target video
One associated instructions of frame；
Second processing module, for searching target additional information corresponding with the associated instructions according to the associated instructions,
The target additional information is superimposed on the target video frame.
14. a kind of computer equipment, which is characterized in that the computer equipment includes processor and memory:
The memory is for storing program instruction, and the processor is for running described program instruction, to execute such as above-mentioned power
The method that benefit requires the described in any item additional information processing of 1-8, or execute as described in the claims any one of 9-11
Additional information processing method, or execute the method that additional information as described in the claims 12 is handled.
15. a kind of computer readable storage medium, including instruction, when run on a computer, so that computer executes such as
The method of the described in any item additional information processing of the claims 1-8, or execute as the claims 9-11 is any
The method of additional information processing described in, or the method for executing the additional information processing as described in the claims 12.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910304629.8A CN110213599A (en) | 2019-04-16 | 2019-04-16 | A kind of method, equipment and the storage medium of additional information processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910304629.8A CN110213599A (en) | 2019-04-16 | 2019-04-16 | A kind of method, equipment and the storage medium of additional information processing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110213599A true CN110213599A (en) | 2019-09-06 |
Family
ID=67786017
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910304629.8A Pending CN110213599A (en) | 2019-04-16 | 2019-04-16 | A kind of method, equipment and the storage medium of additional information processing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110213599A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111314759A (en) * | 2020-03-02 | 2020-06-19 | 腾讯科技（深圳）有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN112887653A (en) * | 2021-01-25 | 2021-06-01 | 联想(北京)有限公司 | Information processing method and information processing device |
| CN112995759A (en) * | 2019-12-13 | 2021-06-18 | 腾讯科技（北京）有限公司 | Interactive service processing method, system, device, equipment and storage medium |
| CN113596493A (en) * | 2021-07-26 | 2021-11-02 | 腾讯科技（深圳）有限公司 | Interactive special effect synchronization method and related device |
| CN113645486A (en) * | 2021-07-16 | 2021-11-12 | 北京爱笔科技有限公司 | Video data processing method and device, computer equipment and storage medium |
| CN114584830A (en) * | 2020-12-02 | 2022-06-03 | 青岛海尔多媒体有限公司 | Method and device for processing video and household appliance |
| CN114630138A (en) * | 2022-03-14 | 2022-06-14 | 上海哔哩哔哩科技有限公司 | Configuration information issuing method and system |
| CN115278292A (en) * | 2022-06-30 | 2022-11-01 | 北京爱奇艺科技有限公司 | Video reasoning information display method and device and electronic equipment |
| WO2023071861A1 (en) * | 2021-10-29 | 2023-05-04 | 影石创新科技股份有限公司 | Data visualization display method and apparatus, computer device, and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105373938A (en) * | 2014-08-27 | 2016-03-02 | 阿里巴巴集团控股有限公司 | Method for identifying commodity in video image and displaying information, device and system |
| CN106202282A (en) * | 2016-07-01 | 2016-12-07 | 刘青山 | Multi-media network shopping guidance system |
| CN106303621A (en) * | 2015-06-01 | 2017-01-04 | 北京中投视讯文化传媒股份有限公司 | The insertion method of a kind of video ads and device |
| CN107995155A (en) * | 2017-10-11 | 2018-05-04 | 上海聚力传媒技术有限公司 | Video data encoding, decoding, methods of exhibiting, video system and storage medium |
-
2019
- 2019-04-16 CN CN201910304629.8A patent/CN110213599A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105373938A (en) * | 2014-08-27 | 2016-03-02 | 阿里巴巴集团控股有限公司 | Method for identifying commodity in video image and displaying information, device and system |
| CN106303621A (en) * | 2015-06-01 | 2017-01-04 | 北京中投视讯文化传媒股份有限公司 | The insertion method of a kind of video ads and device |
| CN106202282A (en) * | 2016-07-01 | 2016-12-07 | 刘青山 | Multi-media network shopping guidance system |
| CN107995155A (en) * | 2017-10-11 | 2018-05-04 | 上海聚力传媒技术有限公司 | Video data encoding, decoding, methods of exhibiting, video system and storage medium |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11736749B2 (en) | 2019-12-13 | 2023-08-22 | Tencent Technology (Shenzhen) Company Limited | Interactive service processing method and system, device, and storage medium |
| CN112995759A (en) * | 2019-12-13 | 2021-06-18 | 腾讯科技（北京）有限公司 | Interactive service processing method, system, device, equipment and storage medium |
| CN111314759A (en) * | 2020-03-02 | 2020-06-19 | 腾讯科技（深圳）有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN111314759B (en) * | 2020-03-02 | 2021-08-10 | 腾讯科技（深圳）有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN114584830A (en) * | 2020-12-02 | 2022-06-03 | 青岛海尔多媒体有限公司 | Method and device for processing video and household appliance |
| CN112887653B (en) * | 2021-01-25 | 2022-10-21 | 联想(北京)有限公司 | Information processing method and information processing device |
| CN112887653A (en) * | 2021-01-25 | 2021-06-01 | 联想(北京)有限公司 | Information processing method and information processing device |
| CN113645486A (en) * | 2021-07-16 | 2021-11-12 | 北京爱笔科技有限公司 | Video data processing method and device, computer equipment and storage medium |
| CN113596493A (en) * | 2021-07-26 | 2021-11-02 | 腾讯科技（深圳）有限公司 | Interactive special effect synchronization method and related device |
| CN113596493B (en) * | 2021-07-26 | 2023-03-10 | 腾讯科技（深圳）有限公司 | Interactive special effect synchronization method and related device |
| WO2023071861A1 (en) * | 2021-10-29 | 2023-05-04 | 影石创新科技股份有限公司 | Data visualization display method and apparatus, computer device, and storage medium |
| CN114630138A (en) * | 2022-03-14 | 2022-06-14 | 上海哔哩哔哩科技有限公司 | Configuration information issuing method and system |
| CN114630138B (en) * | 2022-03-14 | 2023-12-08 | 上海哔哩哔哩科技有限公司 | Configuration information issuing method and system |
| CN115278292A (en) * | 2022-06-30 | 2022-11-01 | 北京爱奇艺科技有限公司 | Video reasoning information display method and device and electronic equipment |
| CN115278292B (en) * | 2022-06-30 | 2023-12-05 | 北京爱奇艺科技有限公司 | Video reasoning information display method and device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110213599A (en) | A kind of method, equipment and the storage medium of additional information processing | |
| CN109194973A (en) | A kind of more main broadcaster's direct broadcasting rooms give the methods of exhibiting, device and equipment of virtual present | |
| CN105338368B (en) | A kind of method, apparatus and system of the live stream turning point multicast data of video | |
| CN108055552B (en) | Direct broadcasting room barrage methods of exhibiting, device and corresponding terminal | |
| CN106993200B (en) | A kind of live broadcasting method of data, relevant device and system | |
| CN105025314B (en) | Multimedia live broadcast method and apparatus | |
| CN106101736A (en) | The methods of exhibiting of a kind of virtual present and system | |
| CN104935955B (en) | A kind of methods, devices and systems transmitting live video stream | |
| CN106131692B (en) | Interactive control method, device and server based on net cast | |
| CN107438200A (en) | The method and apparatus of direct broadcasting room present displaying | |
| CN111491197B (en) | Live content display method and device and storage medium | |
| CN107333162B (en) | Method and device for playing live video | |
| CN108966004A (en) | A kind of method for processing video frequency and terminal | |
| CN111866433B (en) | Video source switching method, video source playing method, video source switching device, video source playing device, video source equipment and storage medium | |
| CN104135667A (en) | Video remote explanation synchronization method, terminal equipment and system | |
| CN109195001A (en) | Methods of exhibiting, device, storage medium and the terminal of present is broadcast live | |
| CN112312144B (en) | Live broadcast method, device, equipment and storage medium | |
| CN110536175A (en) | A kind of code rate switching method and apparatus | |
| CN105959482B (en) | A kind of control method and electronic equipment of scene audio | |
| CN106657657B (en) | Method, the system of mobile terminal and mobile terminal video browsing | |
| CN109189300A (en) | A kind of view circularly exhibiting method and apparatus | |
| CN106101764A (en) | A kind of methods, devices and systems showing video data | |
| CN109729384A (en) | The selection method and device of video code conversion | |
| CN110166848A (en) | A kind of method of living broadcast interactive, relevant apparatus and system | |
| CN108933964A (en) | A kind of barrage display methods, playback equipment and controlling terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190906 |