CN106060609A - Method and device for acquiring picture - Google Patents

Method and device for acquiring picture Download PDF

Info

Publication number
CN106060609A
CN106060609A CN201610378148.8A CN201610378148A CN106060609A CN 106060609 A CN106060609 A CN 106060609A CN 201610378148 A CN201610378148 A CN 201610378148A CN 106060609 A CN106060609 A CN 106060609A
Authority
CN
China
Prior art keywords
picture
time point
audio
pictures
terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610378148.8A
Other languages
Chinese (zh)
Other versions
CN106060609B (en
Inventor
张昀
陈承康
陈泽伟
黄灿辉
林金河
刘晓旋
侯锦坤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201610378148.8A priority Critical patent/CN106060609B/en
Publication of CN106060609A publication Critical patent/CN106060609A/en
Application granted granted Critical
Publication of CN106060609B publication Critical patent/CN106060609B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334—Recording operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Abstract

The invention discloses a method and a device for acquiring a picture, which belong to the technical field of network. A picture acquiring request sent by a first terminal is received, and the picture acquiring request carries a first audio fingerprint; based on the first audio fingerprint, a first time point is acquired from a designated audio fingerprint database, the first time point is the time point for receiving a real-time video stream corresponding to a second audio fingerprint matched with the first audio fingerprint, and the second audio fingerprint is extracted based on the real-time video stream of the video program; and based on the first time point, a corresponding picture is acquired from multiple pictures stored in a designated picture library, and the acquired picture is sent to the first terminal. Thus, the phenomenon that the picture is acquired through a shooting mode is avoided, and the picture definition is improved.

Description

Obtain the method and device of picture
Technical field
The present invention relates to networking technology area, particularly to a kind of method and device obtaining picture.
Background technology
Along with developing rapidly of network technology and multimedia technology, the equipment such as TV, computer and mobile phone has been enter into thousand Family ten thousand families, this kind equipment can provide the user various entertainment service, and such as, user can watch video by this kind equipment Program.Wherein, user during the video frequency program watched by this kind equipment, when to certain video pictures interested time, can To obtain the picture of this video pictures.
At present, during video program play, user can only obtain the picture of video pictures by the way of shooting, also That is, during this video program play, when user is emerging to certain the video pictures sense of the video frequency program that first terminal is play During interest, need by the second terminal, this video pictures to be shot, thus obtain the picture that this video pictures is corresponding.
During realizing the present invention, inventor finds that prior art at least there is problems in that
Owing to user can only obtain the picture of video pictures by the way of shooting, accordingly, it is possible to cause get to regard Frequently the picture blur of picture is unintelligible.
Summary of the invention
In order to solve problem of the prior art, embodiments provide a kind of method and device obtaining picture.Institute State technical scheme as follows:
First aspect, it is provided that a kind of method obtaining picture, described method includes:
Receiving the picture acquisition request that first terminal sends, described picture obtains request and carries the first audio-frequency fingerprint, described The video frequency program recording that second terminal is currently playing is obtained by the first audio-frequency fingerprint by described first terminal；
Based on described first audio-frequency fingerprint, from specifying audio frequency fingerprint base, obtain first time point, described first time point For the reception time point of the live video stream corresponding with the second audio-frequency fingerprint of described first audio-frequency fingerprint coupling, described second sound Frequently fingerprint is that live video stream based on described video frequency program extraction obtains；
Based on described first time point, from the plurality of pictures of designated pictures library storage, obtain the picture of correspondence, described many Pictures is that live video stream based on described video frequency program extraction obtains；
The picture obtained is sent to described first terminal.
Second aspect, it is provided that a kind of method obtaining picture, described method includes:
When receiving picture and obtaining instruction, the video frequency program that the second terminal is currently playing is carried out recording process, obtains First audio-frequency fingerprint；
Based on described first audio-frequency fingerprint, generate picture and obtain request；
Send described picture to server and obtain request, so that described server obtains also based on described first audio-frequency fingerprint Returning the picture that first time point is corresponding, described first time point is the second audio-frequency fingerprint mated with described first audio-frequency fingerprint The reception time point of corresponding live video stream；
Receive the picture that described server sends.
The third aspect, it is provided that a kind of device obtaining picture, described device includes:
First receiver module, the picture sent for receiving first terminal obtains request, and described picture obtains request and carries First audio-frequency fingerprint, the video frequency program that the second terminal is currently playing is recorded by described first audio-frequency fingerprint by described first terminal Arrive；
First acquisition module, for based on described first audio-frequency fingerprint, from specifying audio frequency fingerprint base, obtaining the very first time Point, described first time point is the reception of the live video stream corresponding with the second audio-frequency fingerprint of described first audio-frequency fingerprint coupling Time point, described second audio-frequency fingerprint is that live video stream based on described video frequency program extraction obtains；
Second acquisition module, for the described first time point obtained based on described first acquisition module, from designated pictures Obtaining the picture of correspondence in the plurality of pictures of library storage, described plurality of pictures is that live video stream based on described video frequency program carries Acquirement is arrived；
First sending module, for sending the picture that described second acquisition module obtains to described first terminal.
Fourth aspect, it is provided that a kind of device obtaining picture, described device includes:
Sound recording processing module, is used for when receiving picture and obtaining instruction, the video frequency program currently playing to the second terminal Carry out recording process, obtain the first audio-frequency fingerprint；
Generation module, for processing described first audio-frequency fingerprint obtained based on described sound recording processing module, generates picture Obtain request；
First sending module, for sending, to server, the described picture acquisition request that described generation module generates, so that Described server obtains and returns, based on described first audio-frequency fingerprint, the picture that first time point is corresponding, and described first time point is The reception time point of the live video stream corresponding with the second audio-frequency fingerprint of described first audio-frequency fingerprint coupling；
First receiver module, for receiving the picture that described server sends.
The technical scheme that the embodiment of the present invention provides has the benefit that the mistake at the second terminal plays video frequency program Cheng Zhong, when user to certain broadcasting pictures interested time, by first terminal, the currently playing video of this second terminal can be saved Mesh is recorded, and to obtain the first audio-frequency fingerprint, this first audio-frequency fingerprint is sent in server by this first terminal, i.e. this One terminal sends picture to this server and obtains request, and this picture obtains request and carries this first audio-frequency fingerprint, correspondingly, these clothes After business device receives the acquisition request of this picture, from the appointment audio frequency fingerprint base of this server, obtain and this first audio-frequency fingerprint The reception time point of the live video stream corresponding to the second audio-frequency fingerprint of coupling.Due to the plurality of pictures of storage in designated pictures storehouse Being that live video stream based on this video frequency program extraction obtains, therefore, this server can be based on this reception time point, from appointment The plurality of pictures of picture library storage obtains the picture that this reception time point is corresponding, and acquired picture is sent to this first Terminal so that this first terminal gets the picture of this user broadcasting pictures interested, so, it is to avoid need by shooting Mode obtains picture, improves the definition of picture.
Accompanying drawing explanation
For the technical scheme being illustrated more clearly that in the embodiment of the present invention, in embodiment being described below required for make Accompanying drawing be briefly described, it should be apparent that, below describe in accompanying drawing be only some embodiments of the present invention, for From the point of view of those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to obtain other according to these accompanying drawings Accompanying drawing.
Figure 1A is according to a kind of implementation environment schematic diagram shown in an exemplary embodiment.
Figure 1B is according to a kind of method flow diagram obtaining picture shown in an exemplary embodiment.
Fig. 2 is according to a kind of method flow diagram obtaining picture shown in another exemplary embodiment.
Fig. 3 A is according to a kind of method flow diagram obtaining picture shown in another exemplary embodiment.
Fig. 3 B is a kind of method flow diagram obtaining picture involved by Fig. 3 A embodiment.
Fig. 3 C is a kind of display interface schematic diagram obtaining picture involved by Fig. 3 A embodiment.
Fig. 4 A is the structural representation according to a kind of device obtaining picture shown in an exemplary embodiment.
Fig. 4 B is the structural representation according to a kind of device obtaining picture shown in another exemplary embodiment.
Fig. 4 C is the structural representation according to a kind of device obtaining picture shown in another exemplary embodiment.
Fig. 4 D is the structural representation according to a kind of device obtaining picture shown in another exemplary embodiment.
Fig. 4 E is the structural representation according to a kind of device obtaining picture shown in another exemplary embodiment.
Fig. 5 A is the structural representation according to a kind of device obtaining picture shown in another exemplary embodiment.
Fig. 5 B is the structural representation according to a kind of device obtaining picture shown in another exemplary embodiment.
Fig. 5 C is the structural representation according to a kind of device obtaining picture shown in another exemplary embodiment.
Detailed description of the invention
For making the object, technical solutions and advantages of the present invention clearer, below in conjunction with accompanying drawing to embodiment party of the present invention Formula is described in further detail.
Figure 1A is according to a kind of implementation environment schematic diagram shown in an exemplary embodiment, mainly includes in this implementation environment First terminal the 120, second terminal 110, server 130.Wherein, can pass through between this first terminal 120 and this server 130 Cable network or wireless network set up communication connection.
Wherein, this first terminal 120 can by sound pick-up outfit perform recording operation, that is to say, this first terminal 120 to Few video frequency program that may be used for playing the second terminal 110 is recorded, and based on the voice data recorded, determines this sound Frequency is according to corresponding audio-frequency fingerprint.Wherein, this sound pick-up outfit can be the sound pick-up outfit of this first terminal 120 self configuration, or Person, this sound pick-up outfit can also be to have the sound pick-up outfit of annexation with this first terminal 120.Wherein, this first terminal 120 Can be the equipment of such as mobile phone, panel computer or remote controller or the like.
Alternatively, this implementation environment can also include vendor equipment 140, this vendor equipment 140 respectively with this Setting up communication connection by wireless network between two terminals 110 and this server 130, this vendor equipment 140 may be used for This second terminal 110 and this server 130 provide live video stream.
Wherein, this second terminal 110 is for displaying video programs, say, that this second terminal 110 is used for receiving supply The live video stream that business's equipment 140 sends, and this live video stream is played out.Wherein, this second terminal 110 can be with this First terminal 120 belongs to same class equipment, and such as, this second terminal 110 can also be mobile phone, panel computer etc., it addition, this Two terminals 110 can also be the equipment such as television set.
Wherein, this server 130 is for receiving the live video stream that vendor equipment 140 sends, based on this real-time video Stream, obtains plurality of pictures corresponding to live video stream and multiple audio-frequency fingerprint to be matched.Further, this server 130 be additionally operable to by First terminal equipment 120 is recorded obtained audio-frequency fingerprint and is mated with the plurality of audio-frequency fingerprint to be matched, current to determine The picture of the video frequency program play, it implements process and refers to below figure 3A illustrated embodiment.
It should be noted that in embodiments of the present invention, only being to obtain this by this vendor equipment 140 to regard in real time Illustrating, in another embodiment as a example by frequency stream, it is also possible to obtain this live video stream otherwise, the present invention implements This is not limited by example.
Figure 1B is that the present embodiment obtains with this according to a kind of method flow diagram obtaining picture shown in an exemplary embodiment Taking the method for picture to be performed to be illustrated by server, the method for this acquisition picture can include following several step:
Step 101: receive the picture acquisition request that first terminal sends, the acquisition request of this picture is carried the first audio frequency and is referred to Stricture of vagina, the video frequency program recording that the second terminal is currently playing is obtained by this first audio-frequency fingerprint by this first terminal.
Step 102: based on this first audio-frequency fingerprint, from specifying audio frequency fingerprint base, obtains first time point, this first time Between point be the reception time point with the live video stream corresponding to the second audio-frequency fingerprint of this first audio-frequency fingerprint coupling, this second sound Frequently fingerprint is that live video stream based on this video frequency program extraction obtains.
Step 103: based on this first time point, obtain the picture of correspondence from the plurality of pictures of designated pictures library storage, This plurality of pictures is that live video stream based on this video frequency program extraction obtains.
Step 104: the picture obtained is sent to this first terminal.
In embodiments of the present invention, during the second terminal plays video frequency program, when user is to certain broadcasting pictures sense During interest, by first terminal, the video frequency program that this second terminal is currently playing can be recorded, to obtain the first audio frequency Fingerprint, this first audio-frequency fingerprint is sent to server by this first terminal, i.e. this first terminal sends picture to this server Obtaining request, wherein, this picture obtains request and carries this first audio-frequency fingerprint, and correspondingly, this server receives this picture and obtains After taking request, from the appointment audio frequency fingerprint base of this server, obtain the second audio-frequency fingerprint mated with this first audio-frequency fingerprint The reception time point of corresponding live video stream.Owing to the plurality of pictures stored in designated pictures storehouse is based on this video frequency program Live video stream extracts and obtains, and therefore, this server can be based on this reception time point, from multiple figures of designated pictures library storage Sheet obtains the picture that this reception time point is corresponding, and acquired picture is sent to this first terminal so that this first end End gets the picture of this user broadcasting pictures interested, so, it is to avoid needs to obtain picture by the way of shooting, improves The definition of picture.
Alternatively, based on this first audio-frequency fingerprint, from specifying audio frequency fingerprint base, obtain first time point, including:
From multiple second audio-frequency fingerprints of this appointment audio frequency fingerprint base storage, obtain target audio fingerprint, this target sound Frequently fingerprint is the second audio-frequency fingerprint mated with this first audio-frequency fingerprint, and the plurality of second audio-frequency fingerprint is based on this video frequency program Live video stream extract obtain；
Based on this target audio fingerprint, from this appointment audio frequency fingerprint base, obtain this first time point.
Alternatively, from multiple second audio-frequency fingerprints specifying the storage of audio frequency fingerprint base, before obtaining target audio fingerprint, Also include:
Receive the live video stream of this video frequency program；
Live video stream based on this video frequency program, determines multiple reception time point；
Based on the live video stream that the plurality of reception time point is corresponding, generate multiple second audio-frequency fingerprint respectively；
Store corresponding with the plurality of second audio-frequency fingerprint for the plurality of reception time point to this appointment audio frequency fingerprint base.
Alternatively, after receiving the live video stream of this video frequency program, also include:
Multiple video flowing fragment is extracted from the live video stream of this video frequency program；
Determine the reception time point of each video flowing fragment in the plurality of video flowing fragment；
For each video flowing fragment in the plurality of video flowing fragment, obtain the plurality of pictures of this video flowing fragment；
Store to this appointment corresponding with the plurality of pictures of this video flowing fragment of time point that receive of this video flowing fragment is schemed In valut.
Alternatively, obtain the plurality of pictures of this video flowing fragment, including:
From this video flowing fragment, obtain multiple I two field pictures, and multiple acquired I two field pictures are defined as this piece of video The plurality of pictures of section, wherein, this live video stream includes multiple I two field pictures and multiple P two field pictures.
Alternatively, the picture obtained is sent after this first terminal, also includes:
When receiving the backtracking picture acquisition request that this first terminal sends, from multiple figures of this designated pictures library storage At least one pictures in sheet, before obtaining this first time point and within the appointment time period that this first time point is nearest；
At least one pictures obtained is sent to this first terminal.
Alternatively, based on this target audio fingerprint, from this appointment audio frequency fingerprint base, after obtaining first time point, also Including:
Determining appointment time difference, this appointment time difference refers to the time difference between this first time point and the second time point, This second time point is to receive this picture to obtain the time point of request；
Correspondingly, the picture obtained is sent after this first terminal by this, also includes:
When receive this first terminal send more newly requested time, determine the 3rd time point, the 3rd time point for receive This more newly requested time point, this is more newly requested for indicating the picture to currently playing video frequency program to be updated；
Based on this appointment time difference and the 3rd time point, from the plurality of pictures of this designated pictures library storage, obtaining should Second terminal plays the picture of this video frequency program at the 3rd time point；
The picture that this second terminal plays this video frequency program at the 3rd time point is sent to this first terminal.
Alternatively, based on this appointment time difference and the 3rd time point, from the plurality of pictures of this designated pictures library storage, Obtain this second terminal and play the picture of this video frequency program at the 3rd time point, including:
3rd time point is deducted this appointment time difference, obtains picture and update time point；
From the plurality of pictures of designated pictures library storage, obtain this second terminal and update time point at this picture and play this and regard Frequently the picture of program；
Acquired picture is defined as this second terminal and plays the picture of this video frequency program at the 3rd time point.
Above-mentioned all optional technical schemes, all can be according to arbitrarily combining the alternative embodiment forming the present invention, and the present invention is real Execute example this is repeated the most one by one.
Fig. 2 is that the present embodiment is with this according to a kind of method flow diagram obtaining picture shown in another exemplary embodiment The method obtaining picture is performed to be illustrated by first terminal, and the method for this acquisition picture can include following several step Rapid:
Step 201: when receiving picture and obtaining instruction, the video frequency program that the second terminal is currently playing is carried out at recording Reason, obtains the first audio-frequency fingerprint.
Step 202: based on this first audio-frequency fingerprint, generates picture and obtains request.
Step 203: send this picture to server and obtain request, so that this server obtains based on this first audio-frequency fingerprint And returning the picture that first time point is corresponding, this first time point is the second audio-frequency fingerprint pair mated with this first audio-frequency fingerprint The reception time point of the live video stream answered.
Step 204: receive the picture that this server sends.
In embodiments of the present invention, during the second terminal plays video frequency program, when user is to certain broadcasting pictures sense During interest, by first terminal, the video frequency program that this second terminal is currently playing can be carried out recording process, obtain the first sound Frequently fingerprint, that is to say, when first terminal receives picture acquisition instruction, carries out the video frequency program that the second terminal is currently playing Recording processes, and based on this first audio-frequency fingerprint, generates picture and obtains request, and this first terminal sends this picture to server and obtains Request, correspondingly, after this server receives the acquisition request of this picture, from the appointment audio frequency fingerprint base of this server, obtains The reception time point of the live video stream corresponding with the second audio-frequency fingerprint of this first audio-frequency fingerprint coupling.Due to designated pictures storehouse The plurality of pictures of middle storage is that live video stream based on this video frequency program extraction obtains, and therefore, this server can be based on this Receive time point, from the plurality of pictures of designated pictures library storage, obtain the picture that this reception time point is corresponding, and by acquired Picture send to this first terminal so that this first terminal gets the picture of this user broadcasting pictures interested, so, Avoid the need for obtaining picture by the way of shooting, improve the definition of picture.
Alternatively, after receiving the picture that this server sends, also include:
When receiving backtracking picture and obtaining instruction, send backtracking picture to this server and obtain request, this backtracking picture The request that obtains is before indicate this server to obtain and return this first time point and from the nearest appointment of this first time point At least one pictures in time period；
Receive this at least one pictures that this server sends.
Alternatively, after receiving the picture that this server sends, also include:
When receiving renewal instruction, sending more newly requested to this server, this is more newly requested for indicating this server The picture of currently playing video frequency program is updated；
Receive this second terminal that this server sends and play the picture of this video frequency program at the 3rd time point, the 3rd Time point is to receive this more newly requested time point.
Above-mentioned all optional technical schemes, all can be according to arbitrarily combining the alternative embodiment forming the present invention, and the present invention is real Execute example this is repeated the most one by one.
Fig. 3 A is that the present embodiment is with many according to a kind of method flow diagram obtaining picture shown in another exemplary embodiment The method that square mutual mode realizes this acquisition picture is illustrated, and the method for this acquisition picture can include the most several Step:
Step 301: server receives the live video stream that vendor equipment sends.
At present, during the second terminal plays video frequency program, if certain broadcasting picture that user is to this video frequency program Face is interested, then can only be shot broadcasting pictures by first terminal, obtains the picture of this broadcasting pictures, but, so The picture obtained is the most smudgy clear.To this end, in embodiments of the present invention, it is provided that a kind of method obtaining picture, i.e. exist During displaying video programs, when user to certain broadcasting pictures of this video frequency program interested time, can by this first The video frequency program that this second terminal is currently playing is recorded by terminal, to obtain the first audio-frequency fingerprint, and by this first audio frequency Fingerprint sends to server, by server according to this first audio-frequency fingerprint, obtains broadcasting pictures during first terminal recording Picture, that is to say and obtain the picture wanted of this user.
Wherein, in order to ensure that server gets the picture of currently playing video frequency program, refer to Fig. 3 B, the present invention is real Executing example and access vendor equipment in this server, this vendor equipment can be that this server provides this second terminal currently to broadcast The live video stream of the video frequency program put.In order to ensure reliability of service, this server can access multiple different supplier Equipment, to ensure that this server can get the live video stream of this video frequency program.Wherein, this server reception supplier sets After the live video stream of this video frequency program that preparation is sent, live video stream based on this video frequency program, carry out simultaneously following (1) and (2) two aspects process:
(1), live video stream based on this video frequency program, determine multiple reception time point, based on the plurality of reception time The live video stream that point is corresponding, generates multiple second audio-frequency fingerprint, respectively by the plurality of reception time point and the plurality of second sound Frequently fingerprint correspondence stores to this appointment audio frequency fingerprint base.
Wherein, the plurality of reception time point can be that server determines from the live video stream of this video frequency program at random Arrive, or according to specifying strategy to acquire, certainly, this server can also extract from the live video stream of this video frequency program Multiple audio stream fragments, determine the reception time point of each audio stream fragment in the plurality of audio stream fragment, by the plurality of audio frequency Multiple reception time points during the reception time point of each audio stream fragment is defined as above-mentioned aspect (1) in flow section.
It should be noted that specifying strategy can be that server is arranged in advance, this is not done specifically by the embodiment of the present invention Limit.
It addition, in embodiments of the present invention, the live video stream that the second audio-frequency fingerprint is corresponding can be that server regards from this Frequently extracting in the live video stream of program and obtain, that is to say, the live video stream that the second audio-frequency fingerprint is corresponding can be this video A live video stream fragment in the live video stream of program.
Furthermore, in embodiments of the present invention, multiple sound will be extracted from the live video stream of this video frequency program with server Frequently flow section, determines the reception time point of each audio stream fragment in the plurality of audio stream fragment, by the plurality of audio stream fragment In carry out specifically as a example by multiple reception time points of being defined as in above-mentioned aspect (1) of the reception time point of each audio stream fragment Bright, as described below.
On the one hand, this server live video stream based on this video frequency program received, generate multiple second audio-frequency fingerprint, To record, with this first terminal, the first audio-frequency fingerprint obtained to mate.Specifically, this server is receiving this video joint During purpose live video stream, can adopt according to the live video stream specifying the sample frequency video frequency program to receiving Sample, obtains multiple video flowing fragment, and for video flowing fragment each in the plurality of video flowing fragment, this server is from this video flowing Fragment is extracted audio stream fragment, and based on this audio stream fragment, generates the second audio-frequency fingerprint.
Wherein, this appointment sample frequency can be by the most self-defined setting of user, it is also possible to write from memory by server Recognizing setting, this is not limited by the embodiment of the present invention.
Wherein, in the embodiment of the present invention, can by audio stream fragment is sampled, filtering etc. is a series of processes operation Obtain this second audio-frequency fingerprint, certainly, in another embodiment, it is also possible at otherwise to this audio stream fragment Reason, to obtain the second audio-frequency fingerprint, this is not limited by the embodiment of the present invention.
Further, since audio stream fragment corresponding to this second audio-frequency fingerprint receive time point and the reception time point of picture The most identical, that is to say, be determined by the reception time point of audio stream fragment corresponding to this second audio-frequency fingerprint, Determine the picture that this reception time point is corresponding.Therefore, in order to determining that recording, with first terminal, the first audio frequency obtained refers to After second audio-frequency fingerprint of stricture of vagina coupling, when may further determine that the reception of the audio stream fragment that this second audio-frequency fingerprint is corresponding Between put correspondence picture, after this server extracts multiple audio stream fragment from the live video stream of this video frequency program, permissible Determining the reception time point of the audio stream fragment that the plurality of audio-frequency fingerprint is corresponding, afterwards, this server can be by the plurality of audio frequency The reception time point of flow section is corresponding with the plurality of second audio-frequency fingerprint to be stored to this appointment audio frequency fingerprint base.
Wherein, this server is deposited corresponding with the plurality of second audio-frequency fingerprint for the reception time point of the plurality of audio stream fragment Store up to this appointment audio frequency fingerprint base may include that, this server sets up the reception time point of the plurality of audio stream fragment and these are many Corresponding relation between individual second audio-frequency fingerprint, stores this corresponding relation to this appointment audio frequency fingerprint base, and with this second Audio-frequency fingerprint is as index.
Certainly, in another embodiment, it is also possible to use alternate manner by the reception time point of the plurality of audio stream fragment Corresponding with the plurality of second audio-frequency fingerprint storing to this appointment audio frequency fingerprint base, this is not limited by the embodiment of the present invention.
(2), from the live video stream of this video frequency program, extract multiple video flowing fragment, determine the plurality of video flowing fragment In the reception time point of each video flowing fragment, for each video flowing fragment in the plurality of video flowing fragment, obtain this and regard The plurality of pictures of flow section frequently, by the reception time point storage corresponding with the plurality of pictures of this video flowing fragment of this video flowing fragment To this designated pictures storehouse.
On the other hand, this server is after receiving the live video stream of this video frequency program, also from the reality of this video frequency program Time video flowing in extract picture.Specifically, this server is during the live video stream receiving this video frequency program, according to upper State appointment sample frequency the live video stream of this video frequency program is sampled, thus obtain multiple video flowing fragment.For this Each video flowing fragment in multiple video flowing fragments, this server extracts plurality of pictures from this video flowing fragment, and should Plurality of pictures is corresponding with the reception time point of this video flowing fragment to be stored to this designated pictures storehouse.
Wherein, in a kind of possible implementation, server can use ffmpeg to extract from this video flowing fragment Plurality of pictures, wherein, this ffmpeg is that one is increased income computer program, may be used for that video flowing carries out encoding and decoding etc. and processes, Thus obtain the picture in video flowing.Certainly, in another embodiment, it is also possible to obtain this plurality of pictures otherwise, This is not limited by the embodiment of the present invention.
Wherein, by the reception corresponding reality stored to this designated pictures storehouse of time point of this plurality of pictures with video flowing fragment Existing mode, may refer to above-mentioned by corresponding with the plurality of second audio-frequency fingerprint for the reception time point of the plurality of audio stream fragment storage Implementation to this appointment audio frequency fingerprint base, repeats no more here.
Wherein, in a kind of possible implementation, this server obtains multiple I two field pictures from this video flowing fragment, And multiple acquired I two field pictures are defined as the plurality of pictures of this video segment, wherein, the live video stream of this video frequency program Include multiple I two field pictures and multiple P two field pictures.
In above-mentioned implementation, owing to multiple snapshot pictures obtained above potentially including multiple I two field pictures with many Open P two field picture, it is generally the case that owing to I two field picture is intracoded frame, that is to say key frame or independent frame, this I frame generally may be used The picture complete to represent a frame, compression of images multiple is relatively low, i.e. separately through this I two field picture, just can go out by decoded back Corresponding broadcasting pictures, therefore, in embodiments of the present invention, obtains this I two field picture from this plurality of pictures, and by this I frame figure As being defined as picture, so, the definition of picture can be improved.
It should be noted that in embodiments of the present invention, it is only to include multiple I with the live video stream of this video frequency program Illustrate as a example by two field picture and multiple P two field pictures, in another embodiment, the live video stream of this video frequency program is also possible to Including B two field picture etc., this is not limited by the embodiment of the present invention.
Wherein, in a kind of possible implementation, after extracting plurality of pictures from this video flowing fragment, it is also possible to right This picture is further processed, and such as, the size of this picture can be adjusted by server according to specified size, So that the picture after Tiao Zhenging can adapt to show in mobile phone, for another example, server can also be the most right according to specified compression ratio In this plurality of pictures, every pictures is compressed, so, by being compressed picture, it is possible to reduce first terminal is to this picture Load time.Afterwards, the picture after server will process stores to this designated pictures storehouse.
Wherein, above-mentioned specified size can be by the most self-defined setting of user, it is also possible to by Server Default Arranging, this is not limited by the embodiment of the present invention.
Wherein, above-mentioned specified compression ratio can be by the most self-defined setting of user, it is also possible to by server Default device, this is not limited by the embodiment of the present invention.
Wherein, in a kind of possible implementation, this designated pictures storehouse can be cdn (Content Delivery Network, content distributing network), that is to say, this server can be by the reception time of this plurality of pictures He this video flowing fragment Point correspondence stores to this cdn, so, can improve the speed obtaining picture.
It addition, in a kind of possible implementation, the reception time point of above-mentioned video flowing fragment and multiple audio frequency flow The reception time point of section all can store with the form of timestamp, and this is not limited by the embodiment of the present invention.
Above-mentioned after the live video stream receiving the video frequency program that supplier sends, by connecing of the plurality of audio stream fragment Receive that time point is corresponding with the plurality of second audio-frequency fingerprint stores to this appointment audio frequency fingerprint base, and by this plurality of pictures and should The reception time point correspondence of video flowing fragment stores to designated pictures storehouse, so, when determining sent with this first terminal Second audio-frequency fingerprint of one audio-frequency fingerprint coupling, and determine the reception time point of audio stream fragment that this second audio-frequency fingerprint is corresponding After, this server i.e. can determine that the picture that time point is corresponding that receives of the audio stream fragment that this second audio-frequency fingerprint is corresponding, namely It is, it may be determined that picture corresponding during first terminal recording.
Step 302: when first terminal receives picture acquisition instruction, the video frequency program currently playing to this second terminal Carry out recording process, obtain the first audio-frequency fingerprint, and based on this first audio-frequency fingerprint, generate picture and obtain request.
As described above, user is during by the second terminal viewing video frequency program, if to certain broadcasting pictures sense Interest, can be recorded to the video frequency program of this second terminal plays by first terminal, obtain voice data, this first end End extracts the first audio-frequency fingerprint from this voice data, and based on this first audio-frequency fingerprint, generates picture and obtain request.
Wherein, the process that implements that the video frequency program of this second terminal plays is recorded by first terminal can be wrapped Include: when this first terminal receives picture acquisition instruction, start sound pick-up outfit, and start the broadcasting of this second terminal unit Video frequency program is recorded.
Wherein, this picture obtains instruction and can be triggered by user, and this user can be triggered by assigned operation, and this appointment is grasped Work can include clicking operation, slide, shake operation, scan operation etc..
Such as, refer to Fig. 3 C, in a kind of possible implementation, this first terminal is provided with appointment application, should Specifying to be provided with in application and shake a tossing item 31, as shown in Fig. 3 C (1), user can click on this and shake a tossing item 31, afterwards, is somebody's turn to do First terminal shows the display interface as shown in Fig. 3 C (2), includes TV option 32 at display interface, and user chooses this TV After option 32, getting final product up and down or this first terminal that rocks from side to side, in that case, this first terminal i.e. can determine that and receives This picture obtains instruction.
Wherein, this appointment application can be by the most self-defined setting of user, it is also possible to given tacit consent to by first terminal Arranging, this is not limited by the embodiment of the present invention.Such as, this appointment application can be wechat etc..
Wherein, this second terminal is carried out after recording obtains voice data by this first terminal, can be by this audio frequency number According to carrying out sampling, filtering etc. is a series of processes operation and obtain these first audio-frequency fingerprints, certainly, in another embodiment, it is also possible to Processing this voice data otherwise, to obtain this first audio-frequency fingerprint, this is not limited by the embodiment of the present invention Fixed.
Step 303: this first terminal sends picture to this server and obtains request, and this picture obtains request and carries the first sound Frequently fingerprint.
Step 304: server receives this picture and obtains request, and based on this first audio-frequency fingerprint, from specifying audio-frequency fingerprint In storehouse, obtaining first time point, this first time point is the reality corresponding with the second audio-frequency fingerprint of this first audio-frequency fingerprint coupling Time video flowing reception time point, this second audio-frequency fingerprint be live video stream based on this video frequency program extract obtain, this sound Frequently this live video stream of flow Duan Weicong extracts and obtain.
Wherein, based on this first audio-frequency fingerprint, from specifying audio frequency fingerprint base, implementing of first time point is obtained Journey may include that from multiple second audio-frequency fingerprints of this appointment audio frequency fingerprint base storage, obtains target audio fingerprint, this target Audio-frequency fingerprint is the second audio-frequency fingerprint mated with this first audio-frequency fingerprint, and the plurality of second audio-frequency fingerprint is for save based on this video Purpose live video stream extracts and obtains, and based on this target audio fingerprint, from this appointment audio frequency fingerprint base, obtains this very first time Point.
It is understood that, it is generally the case that this server receives the time ratio of the live video stream of video frequency program and receives First terminal sends the time of the first audio-frequency fingerprint early, therefore, as described above, is receiving the picture that this first terminal sends Before obtaining request, this server live video stream based on this video frequency program, in specifying audio frequency fingerprint base, storage has this to regard Frequently the live video stream of program is corresponding multiple second audio-frequency fingerprints and the reception time point of multiple audio stream fragment, and, In this designated pictures storehouse storage have plurality of pictures and the reception time point of multiple video flowing fragment, this server receive this first After this picture that terminal sends obtains request, obtain request from this picture and extract this first audio-frequency fingerprint, and from this designated tone In multiple second audio-frequency fingerprints of fingerprint base storage frequently, obtain the second audio-frequency fingerprint mated with this first audio-frequency fingerprint.
After this server determines target audio fingerprint, that is to say, this server determines and mates with this first audio-frequency fingerprint After second audio-frequency fingerprint, further determine that the audio stream data corresponding with this second audio-frequency fingerprint of this first audio-frequency fingerprint coupling Reception time point, wherein, the reception time point of the audio stream data that this second audio-frequency fingerprint is corresponding be this second terminal work as The reception time point of the video flowing fragment that the picture of the video frequency program of front broadcasting is corresponding.
It should be noted that above-mentioned based on this first audio-frequency fingerprint, from specifying audio frequency fingerprint base, obtain first time point Implementation be only exemplary, in another embodiment, it is also possible to otherwise, based on this first audio-frequency fingerprint, From specifying audio frequency fingerprint base, obtaining first time point, this is not limited by the embodiment of the present invention.
Step 305: server, based on this first time point, obtains correspondence from the plurality of pictures of designated pictures library storage Picture, this plurality of pictures is that live video stream based on this video frequency program extraction obtains.
This server determines the reception time point of the second audio-frequency fingerprint mated with this first audio-frequency fingerprint, is i.e. equivalent to really Having determined the time point of the picture obtained during the live video stream receiving this video frequency program, this server is from this designated pictures library storage Plurality of pictures in obtain the picture that this first time point is corresponding.Wherein, as described above, this designated pictures storehouse prestores Have plurality of pictures that the live video stream of this video frequency program is corresponding and multiple video flowing fragments corresponding to this plurality of picture time Between point.
Step 306: the picture obtained is sent to this first terminal by server.
Server is based on this first time point, after determining this picture, sends this picture to this first terminal, so, and should First terminal i.e. gets the picture that user actually wants to, and afterwards, this accessed picture can be carried out by this first terminal Downloading, share or collection etc. processes, this is not limited by the embodiment of the present invention.
So far, the embodiment of the present invention achieves the method obtaining picture, it addition, in a kind of possible implementation, should After user gets this picture, it is also possible to wish to obtain the picture of the picture of the history broadcasting of this video frequency program, or, at another Plant in possible implementation, after this user gets this picture, during follow-up viewing video frequency program, it is also possible to continue Want to obtain the picture of follow-up watched video frequency program, to this end, the embodiment of the present invention additionally provides following steps 307 and step 308。
Step 307: first terminal request server obtains the picture of the backtracking picture of currently playing video frequency program.
Wherein, the history before this backtracking picture refers to the time point of this second terminal this video frequency program currently playing is play Picture.This first terminal request server obtains the process that the realizes bag of the picture of the backtracking picture of currently playing video frequency program Include: when receiving the backtracking picture that this first terminal sends and obtaining request, server is from multiple of this designated pictures library storage In picture, at least one pictures before obtaining this first time point and within the appointment time period that this first time point is nearest, At least one pictures obtained is sent to this first terminal.
Wherein, it is intended that the time period can be by the most self-defined setting of user, it is also possible to set by Server Default Putting, this is not limited by the embodiment of the present invention.
Specifically, after first terminal receives backtracking picture acquisition instruction, obtain to this server transmission backtracking picture and ask Ask, correspondingly, after server receives the acquisition request of this backtracking picture, determine that the last time determines the time point of picture, that is to say, Determine first time point, and determine at least one time point in the appointment time period before this first time point, afterwards, these clothes Business device from this designated pictures storehouse, obtain at least one pictures that this at least one time point is corresponding, this server by this at least one Pictures sends to this first terminal, and so, this first terminal has i.e. obtained the history broadcasting of currently playing video frequency program The picture of picture, i.e. this first terminal obtain the picture of the backtracking picture of currently playing video frequency program.
Wherein, this backtracking picture acquisition instruction is used for indicating this first terminal to ask to the transmission backtracking picture acquisition of this server Asking, this backtracking picture obtains instruction and can be triggered by user, and this user can be triggered by above-mentioned assigned operation.
Above-mentioned first terminal sends backtracking picture to this server and obtains request so that server obtains and returns and currently broadcasts At least one pictures of the history broadcasting pictures of the video frequency program put, adds the mode obtaining picture, and, this at least Picture can be linked to be a fragmentary story, it is simple to user quickly understands the history of this video frequency program and plays content, thus carries High Consumer's Experience.
It should be noted that in embodiments of the present invention, it is only with when receiving the backtracking picture that this first terminal sends When obtaining request, this server is from the plurality of pictures of this designated pictures library storage, before obtaining this first time point and from this Illustrate as a example by least one pictures in the appointment time period that first time point is nearest, in another embodiment, work as reception When the backtracking picture sent to this first terminal obtains request, this server can also be from multiple figures of this designated pictures library storage In sheet, before obtaining this first time point and from the picture of the nearest predetermined number of this first time point, wherein, predetermined number can With by the most self-defined setting of user, it is also possible to being arranged by Server Default, this is not limited by the embodiment of the present invention Fixed.
Step 308: the picture of currently playing video frequency program is updated by first terminal request server.
Wherein, this first terminal request server is to implementing that the picture of currently playing video frequency program is updated Process may include that and determines appointment time difference, this appointment time difference refer between this first time point and the second time point time Between poor, this second time point be receive this picture obtain request time point, when receive this first terminal send renewal please When asking, determining that the 3rd time point, the 3rd time point are to receive this more newly requested time point, this is more newly requested right for indicating The picture of currently playing video frequency program is updated, based on this appointment time difference and the 3rd time point, from this designated pictures In the plurality of pictures of library storage, obtain this second terminal and play the picture of this video frequency program at the 3rd time point, by this second The picture that terminal plays this video frequency program at the 3rd time point sends to this first terminal.
During reality realizes, owing to server is an actually-received regarding in real time of the video frequency program of vendor equipment transmission The time of frequency stream has time difference, therefore, in order to user obtains figure again follow-up with the time of the video frequency program of user's viewing During sheet, it is possible to be accurately obtained the picture that user actually wants to obtain, after determining first time point and the second time point, clothes Business device determines the time difference between this first time point and this second time point, i.e. determines above-mentioned appointment time difference.
Wherein, when this first terminal receives renewal instruction, send more newly requested to server, correspondingly, server Receive this more newly requested after, determine and current receive this more newly requested time point.
Wherein, this renewal instruction is used for indicating this first terminal to send more newly requested to server, and this renewal instruction is permissible Being triggered by user, this user can be triggered by above-mentioned assigned operation.
Wherein, based on this appointment time difference and the 3rd time point, from the plurality of pictures of this designated pictures library storage, obtain The process that implements taking the picture that this second terminal plays this video frequency program at the 3rd time point may include that this server 3rd time point is deducted this appointment time difference, obtains picture and update time point, from the plurality of pictures of designated pictures library storage In, obtain this second terminal and play the picture of this video frequency program at this picture renewal time point, acquired picture is defined as This second terminal plays the picture of this video frequency program at the 3rd time point.
That is to say, server deducts this appointment time difference by receiving this more newly requested time point, has i.e. obtained this user The time point of the picture of the broadcasting pictures actually wanted to, so, it is ensured that obtain the accuracy of picture.
After server obtains this time point correspondence picture, sending this picture to this first terminal, so, it is right i.e. to achieve The renewal of the picture of the broadcasting pictures of currently playing video frequency program.That is to say, in embodiments of the present invention, when this user again When wanting to obtain picture, it is only necessary to by this first terminal is performed assigned operation, can again get the picture after renewal, And without again recording the video frequency program that the second terminal is currently playing, so, user is by performing this first terminal Simple assigned operation, can quickly catch up with the progress playing this video frequency program, to obtain up-to-date broadcasting pictures, improve behaviour The convenience made, namely improve Consumer's Experience.
In embodiments of the present invention, during the second terminal plays video frequency program, when user is to certain broadcasting pictures sense During interest, by first terminal, the video frequency program that this second terminal is currently playing can be recorded, to obtain the first audio frequency Fingerprint, this first audio-frequency fingerprint is sent to server by this first terminal, i.e. this first terminal sends picture to this server Obtaining request, this picture obtains request and carries this first audio-frequency fingerprint, and correspondingly, this server receives this picture and obtains request After, from multiple second audio-frequency fingerprints that the appointment audio frequency fingerprint base of this server is stored, obtain and this first audio-frequency fingerprint Second audio-frequency fingerprint of coupling, and based on the second accessed audio-frequency fingerprint, obtain the audio frequency that this second audio-frequency fingerprint is corresponding The reception time point of flow section.Owing in designated pictures storehouse, the plurality of pictures of storage is live video stream based on this video frequency program Extraction obtains, and therefore, this server can be based on this reception time point, and obtaining from the plurality of pictures of designated pictures library storage should Receive the picture that time point is corresponding, and acquired picture is sent to this first terminal so that this first terminal gets this The picture of the broadcasting pictures that user is interested, so, it is to avoid need to obtain picture by the way of shooting, improve the clear of picture Clear degree.It addition, by this first terminal is performed above-mentioned assigned operation, the video that this second terminal is currently playing can be got Plurality of pictures in a period of time of program, in order to user obtains oneself picture interested from this plurality of pictures, i.e. carries High Consumer's Experience.
Fig. 4 A is the structural representation according to a kind of device obtaining picture shown in an exemplary embodiment, this acquisition figure The device of sheet can be by software, hardware or both be implemented in combination with.The device of this acquisition picture may include that
First receiver module 410, the picture sent for receiving first terminal obtains request, and this picture obtains request and carries First audio-frequency fingerprint, the video frequency program recording that the second terminal is currently playing is obtained by this first audio-frequency fingerprint by this first terminal；
First acquisition module 412, for based on described first audio-frequency fingerprint, from specifying audio frequency fingerprint base, obtaining first Time point, described first time point is the live video stream corresponding with the second audio-frequency fingerprint of described first audio-frequency fingerprint coupling Receiving time point, described second audio-frequency fingerprint is that live video stream based on described video frequency program extraction obtains；
Second acquisition module 414, for this first time point obtained based on this first acquisition module 412, from specifying figure Obtaining the picture of correspondence in the plurality of pictures of sheet library storage, this plurality of pictures is that live video stream based on this video frequency program extracts Obtain；
First sending module 416, sends to this first terminal for the picture obtained by this second acquisition module 414.
Alternatively, refer to Fig. 4 B to Fig. 4 E, this first acquisition module 412 is used for:
From multiple second audio-frequency fingerprints of this appointment audio frequency fingerprint base storage, obtain target audio fingerprint, this target sound Frequently fingerprint is the second audio-frequency fingerprint mated with this first audio-frequency fingerprint, and the plurality of second audio-frequency fingerprint is based on this video frequency program Live video stream extract obtain；
Based on this target audio fingerprint, from this appointment audio frequency fingerprint base, obtain this first time point.
Alternatively, this device also includes:
Second receiver module 418, for receiving the live video stream of this video frequency program；
First determines module 420, the real-time video of this video frequency program for receiving based on this second receiver module 418 Stream, determines multiple reception time point；
Generation module 422, for the live video stream corresponding based on the plurality of reception time point, generates multiple second respectively Audio-frequency fingerprint；
First memory module 424, for first determining the plurality of reception time point and this generation that module 420 determines by this The plurality of second audio-frequency fingerprint correspondence that module 422 generates stores to this appointment audio frequency fingerprint base.
Alternatively, this device also includes:
First extraction module 426, for extracting multiple video flowing fragment from the live video stream of this video frequency program；
Second determines module 428, each for determining in the plurality of video flowing fragment that this first extraction module 426 extracts The reception time point of video flowing fragment；
3rd acquisition module 430, for for each video flowing fragment in the plurality of video flowing fragment, obtains this video The plurality of pictures of flow section；
Second memory module 432, for by this second reception time point determining this video flowing fragment that module 428 determines Corresponding with the plurality of pictures of this video flowing fragment that the 3rd acquisition module 430 obtains store to this designated pictures storehouse.
Alternatively, the 3rd acquisition module 430 is used for:
From this video flowing fragment, obtain multiple I two field pictures, and multiple acquired I two field pictures are defined as this piece of video The plurality of pictures of section, wherein, this live video stream includes multiple I two field pictures and multiple P two field pictures.
Alternatively, this device also includes:
4th acquisition module 434, for when receiving the backtracking picture acquisition request that this first terminal sends, referring to from this Determine in the plurality of pictures of picture library storage, before obtaining this first time point and from this first time point nearest appointment time period At least one interior pictures；
Second sending module 436, for the 4th acquisition module 434 is obtained at least one pictures send to this first Terminal.
Alternatively, this device also includes:
3rd determines module 438, is used for determining appointment time difference, and this appointment time difference refers to this first time point and second Time difference between time point, this second time point is to receive this picture to obtain the time point of request；
4th determines module 440, for when receive this first terminal send more newly requested time, determined for the 3rd time Point, the 3rd time point is to receive this more newly requested time point, and this is more newly requested for indicating currently playing video joint Purpose picture is updated；
Based on the 3rd, 5th acquisition module 442, for determining that this appointment time difference that module 438 determines is true with the 4th The 3rd time point that cover half block 440 determines, from the plurality of pictures of this designated pictures library storage, obtains this second terminal at this 3rd time point plays the picture of this video frequency program；
3rd sending module 444, this second terminal being used for obtaining the 5th acquisition module 442 is at the 3rd time point The picture playing this video frequency program sends to this first terminal.
Alternatively, the 5th acquisition module 442 is used for:
3rd time point is deducted this appointment time difference, obtains picture and update time point；
From the plurality of pictures of designated pictures library storage, obtain this second terminal and update time point at this picture and play this and regard Frequently the picture of program；
Acquired picture is defined as this second terminal and plays the picture of this video frequency program at the 3rd time point.
In embodiments of the present invention, during the second terminal plays video frequency program, when user is to certain broadcasting pictures sense During interest, by first terminal, the video frequency program that this second terminal is currently playing can be recorded, to obtain the first audio frequency Fingerprint, this first audio-frequency fingerprint is sent to server by this first terminal, i.e. this first terminal sends picture to this server Obtaining request, this picture obtains request and carries this first audio-frequency fingerprint, and correspondingly, this server receives this picture and obtains request After, from the appointment audio frequency fingerprint base of this server, obtain corresponding with the second audio-frequency fingerprint of this first audio-frequency fingerprint coupling The reception time point of live video stream.In designated pictures storehouse, the plurality of pictures of storage is live video stream based on this video frequency program Extraction obtains, and therefore, this server can be based on this reception time point, and obtaining from the plurality of pictures of designated pictures library storage should Receive the picture that time point is corresponding, and acquired picture is sent to this first terminal so that this first terminal gets this The picture of the broadcasting pictures that user is interested, so, it is to avoid need to obtain picture by the way of shooting, improve the clear of picture Clear degree.
Fig. 5 A is the structural representation according to a kind of device obtaining picture shown in an exemplary embodiment, this acquisition figure The device of sheet can be by software, hardware or both be implemented in combination with.The device of this acquisition picture may include that
Sound recording processing module 510, for when receiving picture and obtaining instruction, saves the video that the second terminal is currently playing Mesh carries out recording process, obtains the first audio-frequency fingerprint；
Generation module 520, for processing this first audio-frequency fingerprint obtained based on this sound recording processing module 510, generates figure Sheet obtains request；
First sending module 530, for sending, to server, this picture acquisition request that this generation module generates, so that should Server obtains and returns, based on this first audio-frequency fingerprint, the picture that first time point is corresponding, this first time point be with this first The reception time point of the live video stream corresponding to the second audio-frequency fingerprint of audio-frequency fingerprint coupling；
First receiver module 540, for receiving the picture that this server sends.
Alternatively, refer to Fig. 5 B to Fig. 5 C, this device also includes:
Second sending module 550, for when receiving backtracking picture and obtaining instruction, sending backtracking picture to this server Obtain request, this backtracking picture obtain before request is used for indicating this server to obtain and return this first time point and from this At least one pictures in the appointment time period that one time point is nearest；
Second receiver module 560, for receiving this at least one pictures that this server sends.
Alternatively, this device also includes:
3rd sending module 570, for when receiving renewal instruction, sending more newly requested to this server, this renewal Request is for indicating this server to be updated the picture of currently playing video frequency program；
3rd receiver module 580, this second terminal sent for receiving this server is play at the 3rd time point should The picture of video frequency program, the 3rd time point is to receive this more newly requested time point.
In embodiments of the present invention, during the second terminal plays video frequency program, when user is to certain broadcasting pictures sense During interest, by first terminal, the video frequency program that this second terminal is currently playing can be carried out recording process, obtain the first sound Frequently fingerprint, that is to say, when first terminal receives picture acquisition instruction, carries out the video frequency program that the second terminal is currently playing Recording processes, and based on this first audio-frequency fingerprint, generates picture and obtains request, and this first terminal sends this picture to server and obtains Request, correspondingly, after this server receives the acquisition request of this picture, from the appointment audio frequency fingerprint base of this server, obtains The reception time point of the live video stream corresponding with the second audio-frequency fingerprint of this first audio-frequency fingerprint coupling.Due to designated pictures storehouse The plurality of pictures of middle storage is that live video stream based on this video frequency program extraction obtains, and therefore, this server can be based on this Receive time point, from the plurality of pictures of designated pictures library storage, obtain the picture that this reception time point is corresponding, and by acquired Picture send to this first terminal so that this first terminal gets the picture of this user broadcasting pictures interested, so, Avoid the need for obtaining picture by the way of shooting, improve the definition of picture.
It should be understood that the device obtaining picture that above-described embodiment provides is when realizing the method obtaining picture, only Be illustrated with the division of above-mentioned each functional module, in actual application, can as desired by above-mentioned functions distribution by Different functional modules completes, and the internal structure of equipment will be divided into different functional modules, with complete described above entirely Portion or partial function.It addition, above-described embodiment device obtaining picture provided and the embodiment of the method obtaining picture belong to Same design, it implements process and refers to embodiment of the method, repeats no more here.
One of ordinary skill in the art will appreciate that all or part of step realizing above-described embodiment can pass through hardware Completing, it is also possible to instruct relevant hardware by program and complete, described program can be stored in a kind of computer-readable In storage medium, storage medium mentioned above can be read only memory, disk or CD etc..
The foregoing is only presently preferred embodiments of the present invention, not in order to limit the present invention, all spirit in the present invention and Within principle, any modification, equivalent substitution and improvement etc. made, should be included within the scope of the present invention.

Claims (22)

1. the method obtaining picture, it is characterised in that described method includes:
Receiving the picture that first terminal sends and obtain request, described picture obtains request and carries the first audio-frequency fingerprint, and described first The video frequency program recording that second terminal is currently playing is obtained by audio-frequency fingerprint by described first terminal；
Based on described first audio-frequency fingerprint, from specifying audio frequency fingerprint base, obtain first time point, described first time point be with The reception time point of the live video stream corresponding to the second audio-frequency fingerprint of described first audio-frequency fingerprint coupling, described second audio frequency refers to Stricture of vagina is that live video stream based on described video frequency program extraction obtains；
Based on described first time point, from the plurality of pictures of designated pictures library storage, obtain the picture of correspondence, multiple figures described Sheet is that live video stream based on described video frequency program extraction obtains；
The picture obtained is sent to described first terminal.
2. the method for claim 1, it is characterised in that described based on described first audio-frequency fingerprint, refers to from specifying audio frequency In stricture of vagina storehouse, obtain first time point, including:
From multiple second audio-frequency fingerprints of described appointment audio frequency fingerprint base storage, obtain target audio fingerprint, described target sound Frequently fingerprint is the second audio-frequency fingerprint mated with described first audio-frequency fingerprint, and the plurality of second audio-frequency fingerprint is for regard based on described Frequently the live video stream of program extracts and obtains；
Based on described target audio fingerprint, from described appointment audio frequency fingerprint base, obtain described first time point.
3. the method for claim 1, it is characterised in that described based on described first audio-frequency fingerprint, refers to from specifying audio frequency In stricture of vagina storehouse, before obtaining first time point, also include:
Receive the live video stream of described video frequency program；
Live video stream based on described video frequency program, determines multiple reception time point；
Based on the live video stream that the plurality of reception time point is corresponding, generate multiple second audio-frequency fingerprint respectively；
Store corresponding with the plurality of second audio-frequency fingerprint for the plurality of reception time point to described appointment audio frequency fingerprint base.
4. method as claimed in claim 3, it is characterised in that after the live video stream of the described video frequency program of described reception, Also include:
Multiple video flowing fragment is extracted from the live video stream of described video frequency program；
Determine the reception time point of each video flowing fragment in the plurality of video flowing fragment；
For each video flowing fragment in the plurality of video flowing fragment, obtain the plurality of pictures of described video flowing fragment；
Described video flowing fragment received that time point is corresponding with the plurality of pictures of described video flowing fragment stores to described appointment In picture library.
5. method as claimed in claim 4, it is characterised in that the plurality of pictures of described acquisition described video flowing fragment, including:
From described video flowing fragment, obtain multiple I two field pictures, and multiple acquired I two field pictures are defined as described piece of video The plurality of pictures of section, wherein, described live video stream includes multiple I two field pictures and multiple P two field pictures.
6. the method for claim 1, it is characterised in that described by obtain picture send to described first terminal it After, also include:
When receiving the backtracking picture acquisition request that described first terminal sends, from multiple figures of described designated pictures library storage At least one figure in sheet, before obtaining described first time point and within the appointment time period that described first time point is nearest Sheet；
At least one pictures obtained is sent to described first terminal.
7. the method for claim 1, it is characterised in that described based on described first audio-frequency fingerprint, refers to from specifying audio frequency In stricture of vagina storehouse, after obtaining first time point, also include:
Determine that appointment time difference, described appointment time difference refer to the time difference between described first time point and the second time point, Described second time point is to receive described picture to obtain the time point of request；
Correspondingly, described by after the picture transmission obtained to described first terminal, also include:
When receive described first terminal send more newly requested time, determine the 3rd time point, described 3rd time point for receive Described more newly requested time point, described more newly requested for indicating the picture to currently playing video frequency program to be updated；
Based on described appointment time difference and described 3rd time point, from the plurality of pictures of described designated pictures library storage, obtain Described second terminal plays the picture of described video frequency program at described 3rd time point；
The picture that described second terminal plays described video frequency program at described 3rd time point is sent to described first terminal.
8. method as claimed in claim 7, it is characterised in that described based on described appointment time difference with described 3rd time Point, from the plurality of pictures of described designated pictures library storage, obtains described second terminal and plays described at described 3rd time point The picture of video frequency program, including:
Described 3rd time point is deducted described appointment time difference, obtains picture and update time point；
From the plurality of pictures of designated pictures library storage, obtain described second terminal and update described in time point broadcasting at described picture The picture of video frequency program；
Acquired picture is defined as described second terminal and plays the picture of described video frequency program at described 3rd time point.
9. the method obtaining picture, it is characterised in that described method includes:
When receiving picture and obtaining instruction, the video frequency program that the second terminal is currently playing is carried out recording process, obtains first Audio-frequency fingerprint；
Based on described first audio-frequency fingerprint, generate picture and obtain request；
Send described picture to server and obtain request, so that described server obtains based on described first audio-frequency fingerprint and returns The picture that first time point is corresponding, described first time point is corresponding with the second audio-frequency fingerprint of described first audio-frequency fingerprint coupling The reception time point of live video stream；
Receive the picture that described server sends.
10. method as claimed in claim 9, it is characterised in that after the picture that the described server of described reception sends, also wrap Include:
When receiving backtracking picture and obtaining instruction, send backtracking picture to described server and obtain request, described backtracking picture Before acquisition request is used for indicating described server to obtain and return described first time point and nearest from described first time point Specify at least one pictures in the time period；
Receive described at least one pictures that described server sends.
11. methods as claimed in claim 9, it is characterised in that after the picture that the described server of described reception sends, also wrap Include:
When receiving renewal instruction, send more newly requested to described server, described more newly requested for indicating described service The picture of currently playing video frequency program is updated by device；
Described second terminal receiving the transmission of described server plays the picture of described video frequency program, institute at described 3rd time point Stating the 3rd time point is time point more newly requested described in reception.
12. 1 kinds of devices obtaining picture, it is characterised in that described device includes:
First receiver module, the picture sent for receiving first terminal obtains request, and described picture obtains request and carries first Audio-frequency fingerprint, the video frequency program recording that the second terminal is currently playing is obtained by described first audio-frequency fingerprint by described first terminal；
First acquisition module, for based on described first audio-frequency fingerprint, from specifying audio frequency fingerprint base, obtaining first time point, When described first time point is the reception of the live video stream corresponding with the second audio-frequency fingerprint of described first audio-frequency fingerprint coupling Between point, described second audio-frequency fingerprint be live video stream based on described video frequency program extract obtain；
Second acquisition module, for the described first time point obtained based on described first acquisition module, from designated pictures stock Obtaining the picture of correspondence in the plurality of pictures of storage, described plurality of pictures is that live video stream based on described video frequency program extracts Arrive；
First sending module, for sending the picture that described second acquisition module obtains to described first terminal.
13. devices as claimed in claim 12, it is characterised in that described first acquisition module is used for:
From multiple second audio-frequency fingerprints of described appointment audio frequency fingerprint base storage, obtain target audio fingerprint, described target sound Frequently fingerprint is the second audio-frequency fingerprint mated with described first audio-frequency fingerprint, and the plurality of second audio-frequency fingerprint is for regard based on described Frequently the live video stream of program extracts and obtains；
Based on described target audio fingerprint, from described appointment audio frequency fingerprint base, obtain described first time point.
14. devices as claimed in claim 12, it is characterised in that described device also includes:
Second receiver module, for receiving the live video stream of described video frequency program；
First determines module, the live video stream of the described video frequency program for receiving based on described second receiver module, determines Multiple reception time points；
Generation module, for the live video stream corresponding based on the plurality of reception time point, generates multiple second audio frequency respectively Fingerprint；
First memory module, for determining the plurality of reception time point and described generation module that module determines by described first The plurality of second audio-frequency fingerprint correspondence generated stores to described appointment audio frequency fingerprint base.
15. devices as claimed in claim 14, it is characterised in that described device also includes:
First extraction module, for extracting multiple video flowing fragment from the live video stream of described video frequency program；
Second determines module, for determining each video flowing in the plurality of video flowing fragment that described first extraction module extracts The reception time point of fragment；
3rd acquisition module, for for each video flowing fragment in the plurality of video flowing fragment, obtains described video flowing The plurality of pictures of fragment；
Second memory module, for determining the reception time point of described video flowing fragment that module determines and described by described second The plurality of pictures correspondence of the described video flowing fragment that the 3rd acquisition module obtains stores to described designated pictures storehouse.
16. devices as claimed in claim 15, it is characterised in that described 3rd acquisition module is used for:
From described video flowing fragment, obtain multiple I two field pictures, and multiple acquired I two field pictures are defined as described piece of video The plurality of pictures of section, wherein, described live video stream includes multiple I two field pictures and multiple P two field pictures.
17. devices as claimed in claim 12, it is characterised in that described device also includes:
4th acquisition module, for when receiving the backtracking picture acquisition request that described first terminal sends, from described appointment In the plurality of pictures of picture library storage, before obtaining described first time point and from described first time point nearest appointment time At least one pictures in Duan；
Second sending module, for sending at least one pictures that described 4th acquisition module obtains to described first terminal.
18. devices as claimed in claim 12, it is characterised in that described device also includes:
3rd determines module, is used for determining when appointment time difference, described appointment time difference refer to described first time point with second Between point between time difference, described second time point be receive described picture obtain request time point；
4th determines module, for when receive described first terminal send more newly requested time, determine the 3rd time point, described 3rd time point is time point more newly requested described in reception, described more newly requested for indicating currently playing video frequency program Picture be updated；
Based on the described 3rd, 5th acquisition module, for determining that the described appointment time difference and the described 4th that module determines determines mould Described 3rd time point that block determines, from the plurality of pictures of described designated pictures library storage, obtains described second terminal in institute State the 3rd time point and play the picture of described video frequency program；
3rd sending module, plays at described 3rd time point for described second terminal obtained by described 5th acquisition module The picture of described video frequency program sends to described first terminal.
19. devices as claimed in claim 18, it is characterised in that described 5th acquisition module is used for:
Described 3rd time point is deducted described appointment time difference, obtains picture and update time point；
From the plurality of pictures of designated pictures library storage, obtain described second terminal and update described in time point broadcasting at described picture The picture of video frequency program；
Acquired picture is defined as described second terminal and plays the picture of described video frequency program at described 3rd time point.
20. 1 kinds of devices obtaining picture, it is characterised in that described device includes:
Sound recording processing module, for when receiving picture and obtaining instruction, carrying out the video frequency program that the second terminal is currently playing Recording processes, and obtains the first audio-frequency fingerprint；
Generation module, for processing described first audio-frequency fingerprint obtained based on described sound recording processing module, generates picture and obtains Request；
First sending module, for sending, to server, the described picture acquisition request that described generation module generates, so that described Server obtains and returns, based on described first audio-frequency fingerprint, the picture that first time point is corresponding, described first time point for institute State the reception time point of the live video stream corresponding to the second audio-frequency fingerprint of the first audio-frequency fingerprint coupling；
First receiver module, for receiving the picture that described server sends.
21. devices as claimed in claim 20, it is characterised in that described device also includes:
Second sending module, for when receiving backtracking picture and obtaining instruction, sends backtracking picture to described server and obtains Request, described backtracking picture obtains before request is used for indicating described server to obtain and return described first time point and from institute State at least one pictures in the appointment time period that first time point is nearest；
Second receiver module, for receiving described at least one pictures that described server sends.
22. devices as claimed in claim 20, it is characterised in that described device also includes:
3rd sending module, for when receiving renewal instruction, sending more newly requested to described server, described more newly requested For indicating described server that the picture of currently playing video frequency program is updated；
3rd receiver module, described second terminal sent for receiving described server is play described at described 3rd time point The picture of video frequency program, described 3rd time point is time point more newly requested described in reception.
CN201610378148.8A 2016-05-31 2016-05-31 Obtain the method and device of picture Active CN106060609B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610378148.8A CN106060609B (en) 2016-05-31 2016-05-31 Obtain the method and device of picture

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610378148.8A CN106060609B (en) 2016-05-31 2016-05-31 Obtain the method and device of picture

Publications (2)

Publication Number Publication Date
CN106060609A true CN106060609A (en) 2016-10-26
CN106060609B CN106060609B (en) 2019-01-22

Family

ID=57171837

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610378148.8A Active CN106060609B (en) 2016-05-31 2016-05-31 Obtain the method and device of picture

Country Status (1)

Country Link
CN (1) CN106060609B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018133309A1 (en) * 2017-01-17 2018-07-26 中兴通讯股份有限公司 Video recording method and device
CN109982140A (en) * 2017-12-28 2019-07-05 优酷网络技术（北京）有限公司 Video broadcasting method and device
CN110839171A (en) * 2018-08-17 2020-02-25 青岛海尔多媒体有限公司 Method and device for applying television screen saver and computer storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120315014A1 (en) * 2011-06-10 2012-12-13 Brian Shuster Audio fingerprinting to bookmark a location within a video
CN104023247A (en) * 2014-05-29 2014-09-03 腾讯科技（深圳）有限公司 Methods and devices for obtaining and pushing information and information interaction system
CN104796729A (en) * 2015-04-09 2015-07-22 宁波创视信息技术有限公司 Method for acquiring high-definition television playing frames in real time

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120315014A1 (en) * 2011-06-10 2012-12-13 Brian Shuster Audio fingerprinting to bookmark a location within a video
CN104023247A (en) * 2014-05-29 2014-09-03 腾讯科技（深圳）有限公司 Methods and devices for obtaining and pushing information and information interaction system
CN104125511A (en) * 2014-05-29 2014-10-29 腾讯科技（深圳）有限公司 Method and device for multimedia data push
CN104796729A (en) * 2015-04-09 2015-07-22 宁波创视信息技术有限公司 Method for acquiring high-definition television playing frames in real time

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018133309A1 (en) * 2017-01-17 2018-07-26 中兴通讯股份有限公司 Video recording method and device
CN109982140A (en) * 2017-12-28 2019-07-05 优酷网络技术（北京）有限公司 Video broadcasting method and device
CN110839171A (en) * 2018-08-17 2020-02-25 青岛海尔多媒体有限公司 Method and device for applying television screen saver and computer storage medium

Also Published As

Publication number Publication date
CN106060609B (en) 2019-01-22

Similar Documents

Publication Publication Date Title
CN105025327B (en) A kind of method and system of mobile terminal live broadcast
CN106162357B (en) Obtain the method and device of video content
CN106162221A (en) The synthetic method of live video, Apparatus and system
CN101523911B (en) Method and apparatus for downloading ancillary program data to dvr
CN105306963B (en) The processing system for video of adaptive mobile terminal resolution ratio, device and method
US9100706B2 (en) Method and system for customising live media content
US8108535B1 (en) Methods, systems, and products for selecting images
CN105704504B (en) Method, device, equipment and storage medium for inserting push information in live video
CN103533394A (en) Information pushing method and device and server
CN110691633B (en) Method and system for determining reaction time of response and synchronizing user interface with content being rendered
CN109561351A (en) Network direct broadcasting back method, device and storage medium
WO2011102508A1 (en) Content playback device
CN106921864A (en) Video broadcasting method and device
CN104584571A (en) Generating a sequence of audio fingerprints at a set top box
CN106664433B (en) Multimedia messages playback method and system, standardized server, live streaming terminal
CN104918061A (en) Television channel identification method and system
CN102347839B (en) Display receiver with content signaturing function
CN103108229A (en) Method for identifying video contents in cross-screen mode through audio frequency
CN105191303B (en) Handle method, the terminal and server of video
CN102790922A (en) Multimedia player and method for sharing multimedia
CN106060609B (en) Obtain the method and device of picture
CN107040825B (en) Terminal, television, multi-screen interaction system and screen capture parameter setting method
CN112804574A (en) Multimedia content transmission and playing method and device
CN107580264A (en) Multimedia resource play handling method and device
JP2006229453A (en) Program presentation system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant