CN105611314A - Method, device and system for acquiring related information of television program - Google Patents

Method, device and system for acquiring related information of television program Download PDF

Info

Publication number
CN105611314A
CN105611314A CN201510993649.2A CN201510993649A CN105611314A CN 105611314 A CN105611314 A CN 105611314A CN 201510993649 A CN201510993649 A CN 201510993649A CN 105611314 A CN105611314 A CN 105611314A
Authority
CN
China
Prior art keywords
audio
frequency
programme
information
fingerprint
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510993649.2A
Other languages
Chinese (zh)
Inventor
周楠
李强
常富洋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Qihoo Technology Co Ltd
Qizhi Software Beijing Co Ltd
Original Assignee
Beijing Qihoo Technology Co Ltd
Qizhi Software Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Qihoo Technology Co Ltd, Qizhi Software Beijing Co Ltd filed Critical Beijing Qihoo Technology Co Ltd
Priority to CN201510993649.2A priority Critical patent/CN105611314A/en
Publication of CN105611314A publication Critical patent/CN105611314A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/233—Processing of audio elementary streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334—Recording operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • H04N21/4756—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for rating content, e.g. scoring a recommended movie
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8547—Content authoring involving timestamps for synchronizing content

Abstract

The embodiment of the invention provides a method, a device and a system for acquiring related information of a television program. The method comprises the following steps of receiving a television program information acquiring command generated by the vibration of a mobile terminal; recording the audio of the television program which is played currently; sending a television program matching request to a server side via a remote interface, wherein the matching of the television program is the matching of audio fingerprints in detail; and receiving the television program information related to the television program which is played currently and returned from the server side and displaying. According to the method provided by the embodiment of the invention, the user can acquire the related information of the television program which is played currently in real time by the way of shaking the mobile terminal, thus the user needs can be met, the data traffic can be saved, and thereby the business promotion is facilitated.

Description

Obtain method, the Apparatus and system of TV programme relevant information
Technical field
The embodiment of the present invention relates to computer realm, and particularly, the embodiment of the present invention relates to one and obtainsThe method of TV programme relevant information, Apparatus and system.
Background technology
Existing radio data system, it is unidirectional that business provides, the arrangement of time of TV programme is fixed,User can only enjoy specific service in the time of specifying. In daily life, user is watching TV FestivalWhen order, often have and the TV programme play or the demand of other user interactions. For example, can participate in working asThe prize drawing of the motor program of front broadcasting, the links such as program request, or, can participate in current TV programmeComment on etc. Along with the development of development of Mobile Internet technology, mobile terminal, for example, the popularity rate of mobile phoneVery high, user can participate in by mobile terminal TV programme or other users' interaction. At present, althoughThe picture of TV has the displaying of information, and by the information of showing, user can carry out certain friendship with TVMutually, but the displaying of this displaying during not for user's Subjective need, or need to participate in program interaction as userTime, about the information of TV interaction has stopped playing, user cannot obtain the information ginseng of TV programme immediatelyWith interaction, cannot meet user's demand.
Summary of the invention
The embodiment of the present invention provides a kind of method, Apparatus and system that obtains TV programme relevant information, orderBe intended at least solve one of above-mentioned technological deficiency, particularly user can by shake mobile terminal mode,Real-time Obtaining audio/video program relevant information, this mode both can meet user's needs, can save again data flowAmount.
The embodiment of the present invention provides a kind of method of obtaining TV programme relevant information, comprises the following steps:The TV program information of mobile terminal receive generation of vibration obtains instruction; Record the TV programme of playingAudio frequency; Send TV programme matching request by remote interface to server end, wherein, described TVProgram coupling is specially the coupling of audio-frequency fingerprint; Receive playing with described that described server end returnsThe TV program information that is associated of TV programme and show.
According to one embodiment of present invention, further, in described TV programme matching request, carry instituteThe audio-frequency fingerprint of stating audio frequency or generating based on described audio frequency.
According to one embodiment of present invention, further, the duration of described audio frequency is first o'clock that presetsLong threshold value.
According to one embodiment of present invention, further, generate audio-frequency fingerprint based on described audio frequency and comprise:Adopt Short Time Fourier Transform algorithm to process described audio frequency, obtain described audio-frequency fingerprint.
According to one embodiment of present invention, further, described employing Short Time Fourier Transform algorithm pairDescribed audio frequency is processed, is obtained described audio-frequency fingerprint and comprises: according to default sample frequency to described soundA frame is frequently sampled; The sampled point of extraction is carried out to Short Time Fourier Transform, when corresponding to obtainFrequently figure; Calculate the value that amplitude in described time-frequency figure meets preset rules, this value to should have the corresponding time andFrequency; By hash algorithm, time difference and difference on the frequency between adjacent described value are calculated, to obtainState the audio-frequency fingerprint of voice data one frame.
According to one embodiment of present invention, further, the frequency range in described time-frequency figure can basisLogarithm carries out cutting, to reduce the audio-frequency fingerprint of described audio frequency.
According to one embodiment of present invention, further, the described server end of described reception return withAfter the TV program information that the TV programme of current broadcasting are associated the step showing, comprise: connectReceive the instruction of sharing described TV program information; Send and share described TV program information by remote interfaceRequest so that described TV program information is shared to the shared platform of request; Receive in response to this requestThe shared object information returning.
A device that obtains TV programme relevant information, comprising: the first receiver module, moves for receivingThe TV program information of moving terminal generation of vibration obtains instruction; The first acquisition module, broadcasts for recordingThe audio frequency of the TV programme of putting; The first sending module, for sending electricity by remote interface to server endDepending on program matching request, wherein, described TV programme coupling is specially the coupling of audio-frequency fingerprint; First is aobviousShow module, for being associated with the described TV programme of playing of receiving that described server end returnsTV program information also shows.
A device that obtains TV programme relevant information, comprising: the 5th receiver module, and far away for passing throughJourney interface receives the TV programme matching request that end side sends; Matching module, for by this TV FestivalThe first audio-frequency fingerprint corresponding to order matching request mates with the second audio-frequency fingerprint of its storage; Push mouldPiece, has for the second audio-frequency fingerprint when its storage the audio frequency matching with described the first audio-frequency fingerprintWhen fingerprint, described in pushing to described end side in response to this TV programme matching request, match secondThe TV program information that audio frequency is corresponding.
Obtain a system for TV programme relevant information, comprise the mobile terminal with device described aboveWith the server end with device described above, described mobile terminal and server end are mutually alternately to realizeObtaining of program-related information.
Compared with prior art, there is following beneficial effect in the embodiment of the present invention:
1, obtain TV program information by the mode of shake mobile terminal, can improve user and experience, increase and useFamily obtains the interest of TV programme relevant information. And this mode is the active obtaining of user while needing, can makeUser obtains the TV program information needing.
2, TV program information is Real-time Obtaining, can meet in time user's needs.
3, the TV program information pushing has to be shared and/or comment function, is conducive to user and appreciates programTime interaction, improve user experience.
4, the TV program information pushing can be sweepstake, when prize drawing, and can be according to user personalized informationCarry out the propelling movement of prize, to meet user's needs. Can improve the well-known of TV programme by sweepstakeDegree and for participating in the liveness of client of TV programme.
The aspect that the embodiment of the present invention is additional and advantage in the following description part provide, and these will be fromIn description below, become obviously, or recognize by the practice of the embodiment of the present invention.
Brief description of the drawings
The embodiment of the present invention above-mentioned and/or additional aspect and advantage below in conjunction with accompanying drawing to embodimentDescription in will become obviously and easily understand, wherein:
Fig. 1 is embodiment of the present invention system architecture schematic diagram;
Fig. 2 is the flow process of an embodiment of the method for obtaining TV programme relevant information of the embodiment of the present inventionSchematic diagram;
Fig. 3 is the stream of another embodiment of the method for obtaining TV programme relevant information of the embodiment of the present inventionJourney schematic diagram;
Fig. 4 is the stream of the another embodiment of the method for obtaining TV programme relevant information of the embodiment of the present inventionJourney schematic diagram;
Fig. 5 is the structure of an embodiment of the device that obtains TV programme relevant information of the embodiment of the present inventionSchematic diagram;
Fig. 6 is the knot of another embodiment of the device that obtains TV programme relevant information of the embodiment of the present inventionStructure schematic diagram.
Detailed description of the invention
Describe embodiments of the invention below in detail, the example of described embodiment is shown in the drawings, whereinSame or similar label represents same or similar element or has identical or similar functions from start to finishElement. Exemplary below by the embodiment being described with reference to the drawings, only for explaining the present invention, andCan not be interpreted as limitation of the present invention.
Unless those skilled in the art of the present technique are appreciated that specially statement, singulative used herein " "," one ", " described " and " being somebody's turn to do " also can comprise plural form. Should be further understood that, thisThe wording using in bright description " comprise " refer to exist described feature, integer, step, operation,Element and/or assembly, but do not get rid of exist or add one or more other features, integer, step,Operation, element, assembly and/or their group. Should be appreciated that, when we claim element to be " connected " or " couplingConnect " when another element, it can be directly connected or coupled to other elements, or in also can existingBetween element. In addition, " connection " used herein or " coupling " can comprise wireless connections or wireless couplingConnect. What wording "and/or" used herein comprised that one or more is associated list whole or timesUnit one and all combination.
Those skilled in the art of the present technique are appreciated that unless otherwise defined, all terms used herein (bagDraw together technical term and scientific terminology), have with the present invention under the general reason of those of ordinary skill in fieldSeparate identical meaning. Should also be understood that such as those terms that define in general dictionary, should be byBe interpreted as and there is the meaning consistent with meaning in the context of prior art, unless and as hereBy specific definitions, otherwise can not explain by idealized or too formal implication.
Those skilled in the art of the present technique had both been appreciated that " terminal " that used, " terminal device " hereComprise the equipment of wireless signal receiver, it only possesses the equipment without the wireless signal receiver of emissivities,Comprise again the equipment that receives and launch hardware, it has and can, on bidirectional communication link, carry out two-wayThe equipment of the reception of letter and transmitting hardware. This equipment can comprise: honeycomb or other communication equipments, itsThere is single line display or multi-line display or do not have the honeycomb of multi-line display or other communication to establishStandby; PCS (PersonalCommunicationsService, PCS Personal Communications System), it can combine languageSound, data processing, fax and/or its communication ability; PDA (PersonalDigitalAssistant,Personal digital assistant), it can comprise radio frequency receiver, pager, the Internet/intranet access, netNetwork browser, notepad, calendar and/or GPS (GlobalPositioningSystem, global positioning systemSystem) receiver; Conventional on knee and/or palmtop computer or other equipment, it has and/or comprises and penetratingFrequently on knee and/or palmtop computer or other equipment of the routine of receiver. Here " terminal " that used," terminal device " can be portable, can transport, be arranged on the vehicles (aviation, sea-freight and/or landGround) in, or be suitable for and/or be configured at local runtime, and/or with distribution form, operate in groundAny other position operation in ball and/or space. Here " terminal ", " terminal device " that used also canTo be communication terminal, access terminals, music/video playback terminal, for example, can be PDA, MID (MobileInternetDevice, mobile internet device) and/or there is the mobile phone of music/video playing function,Also can be the equipment such as intelligent television, Set Top Box.
Those skilled in the art of the present technique are appreciated that the far-end network equipment that used here, it comprise butBe not limited to computer, network host, single network server, multiple webserver collection or multiple serviceThe cloud that device forms. At this, cloud is by a large amount of computers or net based on cloud computing (CloudComputing)Network server forms, and wherein, cloud computing is the one of Distributed Calculation, by the loosely-coupled calculating of a groupA super virtual machine of machine collection composition. In embodiments of the invention, far-end network equipment, terminalBetween equipment and WNS server, can realize and communicating by letter by any communication mode, include but not limited to baseIn the mobile communication of 3GPP, LTE, WIMAX, computer network based on TCP/IP, udp protocolRuton letter and the low coverage wireless transmission method based on bluetooth, infrared transmission standard.
It will be appreciated by those skilled in the art that the present invention's alleged " application ", " application program ", " applicationSoftware " and the concept of similar statement, be those skilled in the art known same concept, refer to by oneThe computer software that is suitable for electronics operation of series of computer instructions and the organic structure of related data resource. RemoveNon-specifying, itself is not subject to programming language kind, rank this name, be not subject to yet its rely operationOperating system or platform limit. In the nature of things, this genus is not limit by any type of terminal yetSystem.
Refer to Fig. 1, Fig. 1 is embodiment of the present invention system architecture schematic diagram, as shown in Figure 1, comprisesMobile terminal 11 and server end 12.
In the present embodiment, mobile terminal 11 is undertaken alternately by telecommunication port with server end 12,Mobile terminal 11 is provided with the client for obtaining TV programme relevant information, server end 12 forThe propelling movement of program-related information. Wherein, server end 12 can carry out with multiple mobile terminals 11 alternately.
Wherein, mobile terminal 11 can be the smart machine such as mobile phone, panel computer, the behaviour of mobile terminal 11Can be the operating systems such as Android, iOS or Windows as system. Server end 12 can be high in the clouds clothesBusiness device.
Fig. 2 is the flow process of an embodiment of the method for obtaining TV programme relevant information of the embodiment of the present inventionSchematic diagram, as shown in Figure 2, comprises the following steps:
Step 101, the TV program information of mobile terminal receive generation of vibration obtains instruction.
In conjunction with Fig. 1, in the time that user televiews, if there is the wish of the program-related information obtained, can shakeMoving mobile terminal 11 carries out obtaining of program-related information. When being specially user and shaking mobile terminal 11,The program-related information that mobile terminal 11 receives its generation of vibration is obtained instruction.
Step 102, records the audio frequency of the TV programme of playing.
In the time receiving program-related information and obtain instruction, enroll the audio frequency of the TV programme of current broadcasting,Admission duration can preset.
Step 103, sends TV programme matching request, TV programme by remote interface to server endCoupling is specially the coupling of audio-frequency fingerprint.
Step 104, the TV Festival that the TV programme with playing that reception server end returns are associatedOrder information also shows.
The audio-frequency fingerprint that carries audio frequency in TV programme matching request or generate based on audio frequency. Described audio frequencyDuration is the first duration threshold value of presetting, for example, be 2 seconds.
Send the TV programme matching request that comprises voice data by remote interface. Be sent to server end12 voice data comprises two kinds of situations: the one, and the voice data of growing more in short-term, mobile terminal 11 is everyInferior admission longer voice data, has enrolled and has been sent to server end 11, until matedNo longer send; The 2nd, the voice data of long duration. For repeatedly sending compared with the situation of short audio data,Can save user data traffic, save transmitting time. Voice data is sent to before server end 12, also needsEncode to reduce its distortion and reduce file size, save flow.
The object that voice data is sent to server end 12 is for by this voice data and server end 12The voice data of storage mates, and matching way is for to mate by audio-frequency fingerprint, audio-frequency fingerprint phaseWhen in the feature of voice data.
Voice data is sent to after server end 12, adopts Short Time Fourier Transform algorithm to this voice dataCalculate to obtain the audio-frequency fingerprint of voice data. Be specially:
A. the frame to the voice data comprising in TV programme matching request according to default sample frequencySample.
B. the sampled point of extraction is carried out to Short Time Fourier Transform, to obtain corresponding time-frequency figure.
Fourier transformation can be analyzed signal, as the composition of: analytic signal, by composition composite signal.Many waveforms can be used as the composition of signal, as: sine wave, square wave, sawtooth waveforms etc., Fourier transformation is adoptedWith the signal composition of sine wave. Wherein, the time dependent rule of signal is time domain specification, signalSignal by which single-frequency synthesizes frequency domain characteristic. Frequency domain is a mathematics model of following ad hoc rulesFarmland, sine wave is the waveform of unique existence in frequency domain, sine wave is the description to frequency domain, and in time domainAny waveform all can be synthesized by sine wave.
The principle of Fourier transformation is: the signal of any continuous measurement, all just can be expressed as different frequencyThe unlimited stack of string ripple signal, utilizes the audio frequency of directly measuring, and calculates in audio frequency different with accumulate modeSinusoidal wave frequency, amplitude and phase place, convert the frequency that is easy to analysis to by reluctant time-domain signalTerritory signal. The frequency domain character that the audio frequency characteristics of the voice data that therefore, the present embodiment obtains is voice data.
C. calculate the value that amplitude in time-frequency figure meets preset rules, this value is to having corresponding time and frequency.
The value calculating is specially the larger value of amplitude in time-frequency figure, because the larger value of amplitude can be used asStrong recognition feature.
D. by hash algorithm, the time difference between consecutive value and difference on the frequency are calculated, to obtain audio frequency numberAccording to the audio-frequency fingerprint of a frame.
Obtain after the audio-frequency fingerprint of voice data, the audio frequency that this audio-frequency fingerprint is stored at server end 12 refers toIn line, mate. Wherein, the audio-frequency fingerprint of storage is corresponding to corresponding voice data, and voice data isThe voice data of the up-to-date scheduled duration of one or more audio/video programs. Describe the sound prestoring below in detailThe acquisition process of audio data.
In the present embodiment, program-related information comprises program recommended information, as: program brief introduction, hostingPeople's data etc. Wherein, program-related information also can comprise program action message, as: advertisement, prize drawing,Red packet information etc.
When the audio frequency having in the audio-frequency fingerprint that server end 12 is stored with mobile terminal 11 voice datas refers toWhen audio-frequency fingerprint that line matches, program-related information corresponding this audio-frequency fingerprint matching is pushed toMobile terminal 11, mobile terminal 11 shows the program-related information pushing. Wherein, program phaseThe propelling movement of pass information is specially: server end 12 obtains the programme of the corresponding television channel of audio-frequency fingerprint,Programme is the broadcast overview of the each program of television channel; By the time of the audio-frequency fingerprint matching and programmeComparison, draws the program under the audio-frequency fingerprint matching according to the time; Obtain the joint corresponding with this programOrder relevant information, for example, draws a lottery, makes comments etc., and server end 12 pushes this program-related information.
In the present embodiment, the program-related information that mobile terminal 11 shows can be shared, and shares processSpecific as follows:
A. receive the instruction of sharing program-related information.
B. send by remote interface the request of sharing program-related information, so that program-related information is sharedTo asking shared platform.
Send asking to server end 12 of shared program-related information according to shared instruction, so that serverProgram-related information is pushed to the shared platform of request by end 12.
C. receive the shared object information returning in response to this request, reception server end 12 returnsShare object information.
Above-mentioned shared procedure is specially: when the program-related information that user's wish shows mobile terminal 11 is carried outWhile sharing, can send shared instruction; In the time that mobile terminal 11 receives the instruction of sharing program-related information,Send a request to server end 12, because server end 12 stores this program-related information, therefore pleaseAsk the mark and the shared platform address of wish that comprise this program-related information; Server end 12 basesProgram-related information is pushed to the shared platform of request by request; After propelling movement completes, will share object informationFeed back to mobile terminal 11, as share a success etc.
In the present embodiment, the program-related information that mobile terminal 11 shows can be used for comment, review processSpecific as follows:
A. receive the instruction of the information of making comments.
B. obtain user's review information.
C. send and comprise that the comment of review information delivers request by remote interface, so that review information is deliveredExtremely for obtaining the client of program-related information.
The comment that comprises review information is delivered to request and be sent to server end 12, so that server end 12Review information is pushed to the client for obtaining program-related information.
D. client shows review information.
Above-mentioned review process is specially: program-related information correspondence mobile terminal 11 being shown when user's wishProgram or activity while commenting on, input review information, the instruction of sending the information of making comments; When movingMoving terminal 11 receives after the instruction of the information of making comments, and obtains review information, and will comprise review informationComment deliver request and be sent to server end 12; Server end 12 by this review information push to forObtain the client of program-related information; After client refreshes, the comment region of program-related information showsThis review information.
In the present embodiment, in the time that program action message is prize drawing information, also can be by shake mobile terminalMode draw a lottery. Concrete prize drawing process is as follows:
A. the prize information that mobile terminal 11 receives its generation of vibration is obtained instruction.
When user obtains after prize drawing information, if there is prize drawing wish, can shake mobile terminal 11 and draw a lottery,The prize information that mobile terminal 11 receives its generation of vibration is obtained instruction.
B. the prize information that transmission comprises user personalized information is obtained and is asked to server end 12.
Prize information is obtained in request and is comprised user personalized information, is the prize for server end 12 is pushedProduct information is pointed. Wherein, user personalized information comprises that user draws a portrait, and has in prize grantingWhen Regional differences, user personalized information also can comprise regional information. User's portrait comprises prize drawing noteRecord and software application information. Describe the process of establishing of user's portrait below in detail:
A. the record of drawing a lottery
Prize drawing is recorded as user and obtains the historical record of prize, comprise obtain prize title, obtain prizeThe lot cast time, obtain the quantity of prize, wherein, the prize that obtains is herein the prize that user has got.
B. software application information
Software application information is specially user's software application situation, as: use kind, the use of softwareThe frequency etc. In the present embodiment, the acquisition of software application information is according to 360 mobile phone bodyguards and 360 mobile phonesAssistant's data source. The effect of software application information is to label (Tag) to user, beats the tool of TagBody process is: each software has corresponding Tag, as: physical culture, news, call a taxi, take-away etc., headFirst capture the Tag of each software, the Tag capturing is arranged, classified; Obtain peace on mobile terminal 11The software information of dress, according to the Tag of the Tag type statistics recurrence user under mounting software, i.e. userInterest. Wherein, for making user's Tag more accurate, also can come user in conjunction with the frequency of usage of softwareTag simplify, as: frequency of usage is the software of 1 time, its Tag can be not as user's Tag.
C. the prize information that server end 12 mobile terminal receives 11 send is obtained request.
D. screen the prize information that can push according to the prize drawing Policy model and the user personalized information that build.
Server end 12 is built with prize drawing Policy model, for screening the prize information that can push, while comprisingBetween section Policy model, region Policy model and prize-winning number of times Policy model. Wherein, the screening of prize informationProcess is specially: obtain after request when server end 12 receives prize information, time period Policy model firstJudge whether this request meets the prize drawing time, whether within the prize drawing time period, if, ground domain policy mouldType judges according to the regional information in user personalized information the prize that this region can push, then the middle level of prizeNumber Policy model further screens the pushed prize of judging, and this screening comprises two kinds of situations,Be for one day can only in a prize once, if in prize drawing record, record today in mistake, do not push awayGive this prize information, another kind is for the prize that only allows preset times in user, if in prize drawing recordRecord the middle preset times of crossing of this prize, do not push this prize information. Wherein, for prize granting notWhile distinguishing region, can not build region Policy model.
E. calculate according to user personalized information and prize current information that can to push the prize-winning of prize information generalRate, and randomly draw prize information according to probability.
The calculating of winning probability is specially, according to software application information, the title of obtaining prize, current prizeProduct quantity, provide prize quantity, prize and provide the userbase of duration and current extraction prize and enterRow calculates. Software application information and the title of obtaining prize are for reflecting user's preference, inclined to one side for userGood prize, can arrange larger probability; The userbase of current extraction prize affects the granting number of prizeAmount, contributes to continuing, evenly providing of prize according to the probability of userbase adjustment prize in real time.
Wherein, current prize quantity, provide prize quantity, prize and provide duration and current extractionThe userbase of prize is prize current information, is multidate information.
Wherein, the probability calculation that is calculated as a class prize of prize information probability, current prize quantity,Providing prize quantity and prize granting duration is also the current information of a class prize.
F. the prize information of extraction is pushed to mobile terminal 11.
G. mobile terminal 11 obtains server end 12 according to the definite prize of user personalized information in requestProduct information.
H. format shows prize information.
Above-mentioned prize drawing mode can push pointed prize to user, improves user and experiences.
Above, the present embodiment can obtain the TV programme of current broadcasting by the mode of shake mobile terminalProgram-related information, this mode is the active obtaining of user while needing, for immediately obtaining, and draws with neatOne ground pushes program-related information and compares, and can make user save data traffic. And the joint of acquisition for mobile terminalOrder relevant information can be shared, comment on, and increases user and the interaction between other people. And by this enforcementExample, in the time learning that program is carrying out a certain activity, can obtain rapidly this movable information, participates in this workMoving.
Fig. 3 is the stream of another embodiment of the method for obtaining TV programme relevant information of the embodiment of the present inventionJourney schematic diagram, as shown in Figure 3, comprises the following steps:
Step 201, receives by remote interface the TV programme matching request that end side sends.
TV programme matching request has two kinds of forms, and one is to comprise voice data, and another kind is to compriseThe audio-frequency fingerprint of voice data, when server end 12 receives after the voice data that mobile terminal 11 sends,Calculate the audio-frequency fingerprint of this voice data, adopt Short Time Fourier Transform algorithm to carry out this voice dataCalculate and obtain its audio frequency characteristics.
Step 202, by second of the first corresponding this TV programme matching request audio-frequency fingerprint and its storageAudio-frequency fingerprint mates.
Server end 12 stores audio-frequency fingerprint, and audio-frequency fingerprint is corresponding to corresponding voice data, audio frequency numberAccording to being the voice data of the up-to-date scheduled duration of one or more TV programme. Server end 12 is also depositedContain program-related information corresponding to TV programme. Program-related information comprises program recommended information, as:Program brief introduction, host information etc. Wherein, program-related information also can comprise program action message, as:Advertisement, prize drawing information, red packet etc.
Step 203, when having the sound matching with the first audio-frequency fingerprint in the second audio-frequency fingerprint of its storageWhen frequency fingerprint, push in response to this TV programme matching request the second audio frequency pair matching to end sideThe TV program information of answering.
When the audio frequency having in the audio-frequency fingerprint that server end 12 is stored with mobile terminal 11 voice datas refers toWhen audio-frequency fingerprint that line matches, TV programme relevant information corresponding this audio-frequency fingerprint matching is pushed awayDeliver to mobile terminal 11, mobile terminal 11 shows the TV programme relevant information pushing. Wherein,The propelling movement of program-related information is specially: server end 12 obtains the joint of the corresponding television channel of audio-frequency fingerprintOrder list, programme is the broadcast overview of the each program of television channel; By the time of the audio-frequency fingerprint matching withProgramme comparison, draws the program under the audio-frequency fingerprint matching according to the time; Obtain and this program pairThe program-related information of answering, server end 12 pushes this program-related information.
Server end receives the corresponding voice data message of program of playing with multiple television channels,Generate the second audio-frequency fingerprint based on voice data message, and the second audio-frequency fingerprint is stored in fingerprint base.The television channel audio frequency of the program that the multiple television channels that can real-time recording third party provide are being play,Third party can be signing television channel etc.
In the time that the duration of the television channel audio frequency of recording reaches default the second duration threshold value, for example 5 seconds,Television channel voice data is packaged into a TS stream, and wherein, a TS stream comprises television channel soundFrequently the first audio time stamp corresponding to every frame voice data in. Also can be multiple corresponding one of voice datasThe first audio time stamp. The one TS stream is packaged into the voice data message of UDP form and passes through long-rangeInterface sends.
Receiving by remote interface after voice data message, from the voice data message of UDP formExtract a TS stream, and a TS stream is reduced into television channel voice data. To television channel audio frequencyData are carried out fingerprint and are generated and process, generate the second audio-frequency fingerprint and with the second audio-frequency fingerprint to corresponding theOne timestamp. The second audio-frequency fingerprint and very first time stamp are stored in fingerprint base.
TS stream (TransportStream, MPTS) is by the multiple composition portion of the audio frequency of TV programmeDivide according to the cross correlation between them and organize and add each part relationship description and program to formInformation, and be further packaged into the code stream after transmission package. TS stream is packaged into transmission package by voice data and passesSend. The transmission package length of TS is fixed, and is generally 188 bytes. Flow and by television channel audio frequency by TSData send by segmentation, can save bandwidth, and can reduce in transmitting procedure and make mistakes.
Can consume larger flow for avoiding that voice data is sent to server end 12, also can directly sendThe audio-frequency fingerprint of television channel voice data is to server end 12. As: within 3 seconds, calculate an audio-frequency fingerprint,Be the audio-frequency fingerprint that television channel voice data is calculated in every admission for 3 seconds afterwards, the audio-frequency fingerprint calculating is sentTo server end 12. The fingerprint of storing in fingerprint base can upgrade in a period of time arranging.
The program audio of the TV programme that harvester top box is broadcasting, when the duration of program audio reaches pre-If the 3rd duration threshold value time, for example 5 seconds, program audio data encapsulation is become to the 2nd TS stream, whereinThe 2nd TS stream comprises the second audio time stamp corresponding to every frame voice data in program audio. ByTwo TS streams are packaged into the audio frequency delay testing message of UDP form and send by remote interface.
Receiving by remote interface after audio frequency delay testing message, surveying from the audio frequency time delay of UDP formIn examination message, extract the 2nd TS stream, and the 2nd TS stream is reduced into program audio data. To program audioData are carried out fingerprint and are generated and process, generate testing audio fingerprint and with testing audio fingerprint to corresponding theTwo timestamps, obtain in fingerprint base with successful the second audio-frequency fingerprint of testing audio fingerprint matching and and itsCorresponding very first time stamp, will stab with the second timestamp and compare the very first time, calculate and obtainThe television channel audio frequency of the TV programme of playing and Set Top Box are play the time delay of same TV programme.
The fingerprint of storing in the fingerprint base of server end has very first time stamp, the audio frequency that Set Top Box collection comesData are calculated generation fingerprint and are had the second timestamp, and 2 timestamps with identical audio-frequency fingerprint are carried outContrast, the difference of 2 timestamps is service end and obtains the signal ratio of television channel audio frequency and pass through Set Top BoxPlay to user the time that same TV programme are done sth. in advance, be a second level pre-set time, for example, be 2 seconds. Work as clothesThe time advance of the television channel audio frequency that business device end obtains is in playing TV Festival object time to user, abilityEnough do not produce larger time delay for user provides better Push Service, and affect user's experience.
The method of calculating audio-frequency fingerprint is specially: according to default sample frequency, one frame of voice data is enteredRow sampling; The sampled point of extraction is carried out to Short Time Fourier Transform, to obtain corresponding time-frequency figure; CalculateIn time-frequency figure, amplitude meets the value of preset rules, and this value is to having corresponding time and frequency; Pass through HashAlgorithm calculated the time difference between consecutive value and difference on the frequency, referred to the audio frequency that obtains voice data one frameLine; Obtain audio-frequency fingerprint by mode one by one, until obtain the audio-frequency fingerprint of whole voice data.
Because the audio-frequency fingerprint obtaining by said method is more, for saving flow, according to the frequency between noteRate variance is logarithm to be changed, and can carry out cutting according to logarithm to the frequency range in time-frequency figure, to reduce audio frequencyThe quantity of fingerprint. As: frequency range is 0-4096Hz, and this scope is divided into 64 deciles.
Above, the present embodiment, by the coupling of audio-frequency fingerprint, is realized the propelling movement of TV programme relevant information.When the audio-frequency fingerprint of the voice data of mobile terminal without match audio-frequency fingerprint time, illustrate that server end does not haveThere is any information of current the play TV programme of memory mobile terminal, can not carry out the relevant letter of programThe propelling movement of breath.
Fig. 4 is the flow process that the embodiment of the present invention is obtained the another embodiment of method of audio/video program relevant informationSchematic diagram, as shown in Figure 4, comprises the following steps:
Step 301, the TV program information of mobile terminal receive generation of vibration obtains instruction.
Step 302, obtains the voice data of the current television program of playing.
Step 303, sends TV programme matching request to server end and carries out Audio Matching, Audio MatchingBe specially the coupling of audio-frequency fingerprint.
Step 304, the TV programme matching request that server end mobile terminal receive sends.
Step 305, by the audio-frequency fingerprint of audio-frequency fingerprint corresponding this TV programme matching request and its storageMate.
Step 306, when having the sound corresponding with this TV programme matching request in the audio-frequency fingerprint of its storageFrequently, when fingerprint matches audio-frequency fingerprint, push in response to this TV programme matching request the sound matchingFrequently program-related information corresponding to fingerprint.
Step 307, the relevant letter of program of the current program that acquisition for mobile terminal display server end pushBreath.
As shown in Figure 5, the embodiment of the present invention provides a kind of device that obtains TV programme relevant information, bagDraw together: the first receiver module 51, the first acquisition module 52, the first sending module 53, the first display module54, sampling module 55, the second acquisition module 56, computing module 57, the 3rd acquisition module 58, secondReceiver module 59, the second sending module 60, the 3rd receiver module 61, the 4th receiver module 62, the 4thAcquisition module 63, the 3rd sending module 64 and the second display module 65.
The concrete function of above-mentioned each module is as follows:
The TV program information of the first receiver module 51 mobile terminal receive generation of vibrations obtains instruction. FirstAcquisition module 52 is recorded the audio frequency of the TV programme of playing. The first sending module 53 connects by long-rangeMouth sends TV programme matching request to server end, and TV programme coupling is specially the coupling of audio-frequency fingerprint.The TV that the TV programme with playing that the first display module 54 reception server ends return are associatedProgramme information also shows.
The audio-frequency fingerprint that carries audio frequency in TV programme matching request or generate based on audio frequency. The duration of audio frequencyFor the first default duration threshold value. Audio-frequency fingerprint is for adopting Short Time Fourier Transform algorithm to count audio frequencyThe feature of calculating and draw.
Sampling module 55 is sampled to a frame of audio frequency according to default sample frequency. The second acquisition moduleThe sampled point of extraction is carried out Short Time Fourier Transform by 56, to obtain corresponding time-frequency figure. Computing module 57In calculating time-frequency figure, amplitude meets the value of preset rules, and this value is to having corresponding time and frequency. The 3rdAcquisition module 58 calculates the time difference between consecutive value and difference on the frequency by hash algorithm, to obtain soundThe audio-frequency fingerprint of audio data one frame. Frequency range in time-frequency figure can be carried out cutting according to logarithm, to reduceThe audio-frequency fingerprint of audio frequency.
The second receiver module 59 return at the first display module 54 reception server ends with current broadcastingThe TV program information that TV programme are associated and show after, receive and share the finger of TV program informationOrder. The second sending module 60 sends the request of sharing TV program information by remote interface, so that TVProgramme information is shared to the shared platform of request. The 3rd receiver module 61 receives and returns in response to this requestShare object information.
The 4th receiver module 62 the first display module reception server end that return with electricity current broadcastingThe TV program information being associated depending on program and show after, receive the instruction of information of making comments.The 4th acquisition module 63 obtains user's review information. The 3rd sending module 64 sends by remote interfaceRequest is delivered in the comment that comprises review information, so that review information is delivered to for obtaining TV program informationClient. The second display module 65 shows review information. Program recommended information, program action message;Program action message comprises: the movable interactive information of program, sweepstake information, red packet information.
Fig. 6 is that the structure that the embodiment of the present invention is obtained another embodiment of device of TV programme relevant information is shownIntention, as shown in Figure 6, comprising: the 5th receiver module 71, matching module 72, pushing module 73,Fingerprint base 74, television audio acquisition module 75, audio repository generation module 76, detection audio collection module77, time delay detection module 78 and fingerprint generation module 79.
The concrete function of above-mentioned each module is as follows:
The 5th receiver module 71 receives by remote interface the TV programme matching request that end side sends.Matching module 72 is by the second sound of the first corresponding this TV programme matching request audio-frequency fingerprint and its storageFrequently fingerprint mates; Match when having in the second audio-frequency fingerprint of its storage with the first audio-frequency fingerprintWhen audio-frequency fingerprint, pushing module 73 pushes and matches to end side in response to this TV programme matching requestTV program information corresponding to the second audio frequency.
Audio repository generation module 76 receives the corresponding audio frequency of program of playing with multiple television channelsData message, generates the second audio-frequency fingerprint based on voice data message, and the second audio-frequency fingerprint is stored inIn fingerprint base 74.
The TV of the program that the multiple television channels of television audio acquisition module 75 real-time recording are being play frequentlyChannel audio. In the time that the duration of the television channel audio frequency of recording reaches default the second duration threshold value, by TVChannel audio data encapsulation becomes a TS stream, and wherein, a TS stream comprises in television channel audio frequencyThe first audio time stamp that every frame voice data is corresponding, television audio acquisition module 75 is by a TS stream envelopeDress up the voice data message of UDP form and send by remote interface. Television audio acquisition module 75Can be deployed in third-party server, gather the TV of the program that multiple television channels are playing frequentlyChannel audio.
Audio repository generation module 75 is receiving by remote interface after voice data message, from UDP latticeIn the voice data message of formula, extract a TS stream, and a TS stream is reduced into television channel audio frequency numberAccording to. Television channel voice data is carried out to fingerprint and generate and process, generate the second audio-frequency fingerprint and with secondAudio-frequency fingerprint is to corresponding very first time stamp. The second audio-frequency fingerprint and very first time stamp are stored in to fingerprintIn storehouse 74.
The program audio of the TV programme that detection audio collection module 77 harvester top boxs are broadcasting, works as jointWhen the duration of order audio frequency reaches default the 3rd duration threshold value, program audio data encapsulation is become to the 2nd TSStream, the 2nd TS stream comprises the second audio time stamp corresponding to every frame voice data in program audio;The 2nd TS stream is packaged into the audio frequency delay testing message of UDP form and sends by remote interface. InspectionAcoustic frequently acquisition module 77 can be deployed in Set Top Box.
Time delay detection module 78 is receiving by remote interface after audio frequency delay testing message, from UDPIn the audio frequency delay testing message of form, extract the 2nd TS stream, and the 2nd TS stream is reduced into program audioData; Program audio data are carried out to fingerprint and generate processing, generate testing audio fingerprint and and test toneFrequently fingerprint is to the second timestamp of correspondence; Time delay detection module 78 is obtained in fingerprint base 74 and testing audioSuccessful the second audio-frequency fingerprint of fingerprint matching and the very first time stamp corresponding with it; To stab the very first time withThe second timestamp is compared, and calculates the television channel audio frequency and the machine top that obtain the TV programme of playingBox is play the time delay of same TV programme.
Fingerprint generation module 79 is sampled to a frame of voice data according to default sample frequency. To adoptThe sampled point going out carries out Short Time Fourier Transform, to obtain corresponding time-frequency figure; Calculate in described time-frequency figureAmplitude meets the value of preset rules, and this value is to having corresponding time and frequency; By hash algorithm to phaseTime difference and difference on the frequency between adjacent described value calculate, and refer to the audio frequency that obtains described voice data one frameLine. Frequency range in time-frequency figure can be carried out cutting according to logarithm, to reduce the audio-frequency fingerprint of voice data.Matching module 72, audio repository generation module 76, time delay detection module 78 are called described fingerprint generation moduleCarry out fingerprint and generate processing.
In conjunction with Fig. 5 and Fig. 6, Fig. 5 shown device is positioned at mobile terminal, and this device is for obtaining TVThe client of program-related information, Fig. 6 shown device is positioned at server end, and the two is mutually mutual, realizesObtaining of current program-related information, this mode is the active obtaining of user while needing, with uniform groundPropelling movement program-related information is compared, and can make user save data traffic.
The above is only part embodiment of the present invention, it should be pointed out that general for the artLogical technical staff, under the premise without departing from the principles of the invention, can also make some improvement and profitDecorations, these improvements and modifications also should be considered as protection scope of the present invention.
The embodiment of the present invention provides following technical scheme:
1, a method of obtaining TV programme relevant information, comprising:
The TV program information of mobile terminal receive generation of vibration obtains instruction;
Record the audio frequency of the TV programme of playing;
Send TV programme matching request by remote interface to server end, wherein, described TV programmeCoupling is specially the coupling of audio-frequency fingerprint;
Receive the TV programme that are associated with the described TV programme of playing that described server end returnsInformation also shows.
2, according to the method for obtaining TV programme relevant information described in 1,
The audio-frequency fingerprint that carries described audio frequency in described TV programme matching request or generate based on described audio frequency.
3, according to the method for obtaining TV programme relevant information described in 1,
The duration of described audio frequency is the first duration threshold value of presetting.
4,, according to the method for obtaining TV programme relevant information described in 2, generate sound based on described audio frequencyFrequently fingerprint comprises:
Adopt Short Time Fourier Transform algorithm to process described audio frequency, obtain described audio-frequency fingerprint.
5, according to the method for obtaining TV programme relevant information described in 2, described employing Fourier in short-termMapping algorithm is processed, is obtained described audio-frequency fingerprint to described audio frequency and comprises:
According to default sample frequency, one frame of described audio frequency is sampled;
The sampled point of extraction is carried out to Short Time Fourier Transform, to obtain corresponding time-frequency figure;
Calculate the value that amplitude in described time-frequency figure meets preset rules, this value is to there being corresponding time and frequentlyRate;
By hash algorithm, time difference and difference on the frequency between adjacent described value are calculated, described in obtainingThe audio-frequency fingerprint of voice data one frame.
6, according to the method for obtaining TV programme relevant information described in 5, the frequency in described time-frequency figureScope can be carried out cutting according to logarithm, to reduce the audio-frequency fingerprint of described audio frequency.
7, according to the method for obtaining TV programme relevant information described in 1, the described server of described receptionThe step of holding the TV program information being associated with TV programme current broadcasting that return and show itAfter comprise:
Receive the instruction of sharing described TV program information;
Send the request of sharing described TV program information by remote interface, so that described TV programme letterBreath is shared to the shared platform of request;
Receive the shared object information returning in response to this request.
8, according to the method for obtaining TV programme relevant information described in 1, the described server of described receptionThe step of holding the TV program information being associated with TV programme current broadcasting that return and show itAfter comprise:
The make comments instruction of information of reception;
Obtain user's review information;
Send and comprise that the comment of described review information delivers request by remote interface, so that described comment letterBreath is delivered to the client for obtaining described TV program information;
Described client shows described review information.
9, according to the method for obtaining TV programme relevant information described in 1 to 8 any one,
Described TV program information comprises: program recommended information, program action message;
Described program action message comprises: the movable interactive information of program, sweepstake information, red packet information.
10, a method of obtaining TV programme relevant information, comprising:
Receive by remote interface the TV programme matching request that end side sends;
The second audio-frequency fingerprint of the first corresponding this TV programme matching request audio-frequency fingerprint and its storage is enteredRow coupling;
When thering is the audio-frequency fingerprint matching with described the first audio-frequency fingerprint in the second audio-frequency fingerprint of its storageTime, the second audio frequency matching described in pushing to described end side in response to this TV programme matching requestCorresponding TV program information.
11, the method as described in 10, comprising:
Receive the corresponding voice data message of program of playing with multiple television channels;
Generate described the second audio-frequency fingerprint based on described voice data message, and by described the second audio-frequency fingerprintBe stored in fingerprint base.
12, the method as described in 11, comprising:
The television channel audio frequency of the program that the multiple television channels of real-time recording are being play;
In the time that the duration of the described television channel audio frequency of recording reaches default the second duration threshold value, will described inTelevision channel voice data is packaged into a TS stream, and wherein, a described TS stream comprises described TVThe first audio time stamp corresponding to every frame voice data in channel audio;
A described TS stream is packaged into the described voice data message of UDP form and passes through remote interfaceSend.
13, the method as described in 12, comprising:
Receiving by remote interface after described voice data message, from the described audio frequency number of UDP formAccording to extracting a TS stream in message, and a described TS stream is reduced into described television channel voice data;
To described television channel voice data carry out fingerprint generate process, generate described the second audio-frequency fingerprint withAnd with described the second audio-frequency fingerprint to corresponding very first time stamp;
Described the second audio-frequency fingerprint and stamp of the described very first time are stored in described fingerprint base.
14, the method as described in 13, comprising:
The program audio of the TV programme that harvester top box is broadcasting reaches in the time of described program audioDuring to default the 3rd duration threshold value, described program audio data encapsulation is become to the 2nd TS stream, wherein,Wherein, described the 2nd TS stream comprises the second sound corresponding to every frame voice data in described program audioFrequently timestamp;
Described the 2nd TS stream is packaged into the described audio frequency delay testing message of UDP form and passes through long-rangeInterface sends.
15, the method as described in 14, comprising:
Receiving by remote interface after described audio frequency delay testing message, from the described sound of UDP formFrequently in delay testing message, extract described the 2nd TS stream, and described the 2nd TS stream is reduced into described programVoice data;
Described program audio data are carried out to described fingerprint and generate and process, generate testing audio fingerprint and withDescribed testing audio fingerprint is to the second timestamp of correspondence;
Obtain in described fingerprint base with successful the second audio-frequency fingerprint of described testing audio fingerprint matching and withIts stamp of corresponding very first time;
Described very first time stamp compared with described the second timestamp, calculate to obtain and playingThe described television channel audio frequency of TV programme and Set Top Box are play the time delay of same TV programme.
16, according to the method for obtaining TV programme relevant information described in 15,
In described TV programme matching request, carry voice data or generate based on described voice data firstAudio-frequency fingerprint;
Wherein, the voice data carrying in described TV programme matching request is carried out to generation place of described fingerprintReason, generates described the first audio-frequency fingerprint.
17,, according to the method for obtaining TV programme relevant information described in 16, described fingerprint generates pack processingDraw together:
According to default sample frequency, one frame of voice data is sampled;
The sampled point of extraction is carried out to Short Time Fourier Transform, to obtain corresponding time-frequency figure;
Calculate the value that amplitude in described time-frequency figure meets preset rules, this value is to there being corresponding time and frequentlyRate;
By hash algorithm, time difference and difference on the frequency between adjacent described value are calculated, described in obtainingThe audio-frequency fingerprint of voice data one frame.
18, according to the method for obtaining TV programme relevant information described in 17, the frequency in described time-frequency figureScope can be carried out cutting according to logarithm, to reduce the audio-frequency fingerprint of described voice data.
19, according to the method for obtaining TV programme relevant information described in 10 to 18 any one,
Described TV program information comprises: program recommended information, program action message;
Described program action message comprises: the movable interactive information of program, sweepstake information, red packet information.
20, a device that obtains TV programme relevant information, comprising:
The first receiver module, obtains instruction for the TV program information of mobile terminal receive generation of vibration;
The first acquisition module, for recording the audio frequency of the TV programme of playing;
The first sending module, for sending TV programme matching request by remote interface to server end,Wherein, described TV programme coupling is specially the coupling of audio-frequency fingerprint;
The first display module, for receive described server end that return with described TV Festival of playingThe TV program information that order is associated also shows.
21, according to the device described in 20,
The audio-frequency fingerprint that carries described audio frequency in described TV programme matching request or generate based on described audio frequency.
22,, according to the device described in 20, the duration of described audio frequency is the first duration threshold value of presetting.
23,, according to the device described in 21, described audio-frequency fingerprint is for adopting Short Time Fourier Transform algorithm pairDescribed audio frequency calculates and the feature that draws.
24, according to the device described in 23, also comprise:
Sampling module, for sampling to a frame of described audio frequency according to default sample frequency;
The second acquisition module, for the sampled point of extraction is carried out to Short Time Fourier Transform, corresponding to obtainTime-frequency figure;
Computing module, meets the value of preset rules for calculating described time-frequency figure amplitude, this value is to havingCorresponding time and frequency;
The 3rd acquisition module, for entering time difference and difference on the frequency between adjacent described value by hash algorithmRow calculates, to obtain the audio-frequency fingerprint of described voice data one frame.
25,, according to the device described in 24, the frequency range in described time-frequency figure can be cut according to logarithmPoint, to reduce the audio-frequency fingerprint of described audio frequency.
26, according to the device described in 20, comprising:
The second receiver module, for receive at described the first display module that described server end returns with work asThe TV program information that the TV programme of front broadcasting are associated and show after, receive share described TVThe instruction of programme information;
The second sending module, for send the request of sharing described TV program information by remote interface,So that described TV program information is shared to the shared platform of request;
The 3rd receiver module, for receiving the shared object information returning in response to this request.
27, according to the device described in 20, comprising:
The 4th receiver module, for receive at described the first display module that described server end returns with work asThe TV program information that the TV programme of front broadcasting are associated and show after, receive the letter of making commentsThe instruction of breath;
The 4th acquisition module, for obtaining user's review information;
The 3rd sending module, the comment that comprises described review information for sending by remote interface is delivered pleaseAsk, so that described review information is delivered to the client for obtaining described TV program information;
The second display module, for showing described review information.
28, according to the device described in 20 to 27 any one,
Described TV program information comprises: program recommended information, program action message;
Described program action message comprises: the movable interactive information of program, sweepstake information, red packet information.
29, a device that obtains TV programme relevant information, comprising:
The 5th receiver module, please for the TV programme coupling that receives end side transmission by remote interfaceAsk;
Matching module, for by the first corresponding this TV programme matching request audio-frequency fingerprint and its storageThe second audio-frequency fingerprint mates;
Pushing module, has and described the first audio-frequency fingerprint phase for the second audio-frequency fingerprint when its storageCoupling audio-frequency fingerprint time, push described phase in response to this TV programme matching request to described end sideThe TV program information corresponding to the second audio frequency of coupling.
30, the device as described in 29, comprising:
Audio repository generation module, for receiving the corresponding sound of program of playing with multiple television channelsAudio data message; Generate described the second audio-frequency fingerprint based on described voice data message, and by described secondAudio-frequency fingerprint is stored in fingerprint base.
31, the device as described in 30, comprising:
Television audio acquisition module, the TV of the program of playing for the multiple television channels of real-time recordingChannel audio; In the time that the duration of the described television channel audio frequency of recording reaches default the second duration threshold value,Described television channel voice data is packaged into a TS stream, and wherein, a described TS stream comprises instituteState the first audio time stamp corresponding to every frame voice data in television channel audio frequency; By a described TSStream is packaged into the described voice data message of UDP form and sends by remote interface.
32, the device as described in 31,
Described audio repository generation module, also for receiving described voice data message by remote interfaceAfter, from the described voice data message of UDP form, extract a TS stream, and by a described TSStream is reduced into described television channel voice data; Described television channel voice data is carried out to fingerprint generation placeReason, generate described the second audio-frequency fingerprint and with described the second audio-frequency fingerprint to corresponding very first time stamp;Described the second audio-frequency fingerprint and stamp of the described very first time are stored in described fingerprint base.
33, the device as described in 32, comprising:
Detect audio collection module, the program audio of the TV programme of broadcasting for harvester top box,In the time that the duration of described program audio reaches default the 3rd duration threshold value, by described program audio data envelopeDress up the 2nd TS stream, wherein, wherein, described the 2nd TS stream comprises the every frame in described program audioThe second audio time stamp that voice data is corresponding; By described the 2nd TS stream be packaged into UDP form described inAudio frequency delay testing message also sends by remote interface.
34, the device as described in 33, comprising:
Time delay detection module, for receiving by remote interface after described audio frequency delay testing message,From the described audio frequency delay testing message of UDP form, extract described the 2nd TS stream, and by described secondTS stream is reduced into described program audio data; Described program audio data are carried out to described fingerprint and generate processing,Generate testing audio fingerprint and with described testing audio fingerprint to the second corresponding timestamp; Described in obtainingIn fingerprint base with successful the second audio-frequency fingerprint of described testing audio fingerprint matching and with it corresponding firstTimestamp; Described very first time stamp is compared with described the second timestamp, calculate to obtain and playThe described television channel audio frequency of TV programme and Set Top Box play the time delay of same TV programme.
35, according to the device described in 34,
In described TV programme matching request, carry voice data or generate based on described voice data firstAudio-frequency fingerprint;
Wherein, described matching module carries out institute to the voice data carrying in described TV programme matching requestState fingerprint and generate processing, generate described the first audio-frequency fingerprint.
36, according to the device described in 35, comprising:
Fingerprint generation module, for sampling to a frame of voice data according to default sample frequency;The sampled point of extraction is carried out to Short Time Fourier Transform, to obtain corresponding time-frequency figure; Calculate described time-frequencyIn figure, amplitude meets the value of preset rules, and this value is to having corresponding time and frequency; Pass through hash algorithmTime difference and difference on the frequency between adjacent described value are calculated, to obtain the sound of described voice data one frameFrequently fingerprint;
Wherein, described matching module, described audio repository generation module, described time delay detection module are called instituteState fingerprint generation module and carry out fingerprint generation processing.
37,, according to the device described in 36, the frequency range in described time-frequency figure can be carried out cutting according to logarithm,To reduce the audio-frequency fingerprint of described voice data.
38, according to the device described in 29 to 37 any one,
Described TV program information comprises: program recommended information, program action message;
Described program action message comprises: the movable interactive information of program, sweepstake information, red packet information.
39, obtain a system for TV programme relevant information, comprise and there is moving of installing described in 20-28Moving terminal and have the server end installing described in 29-38, described mobile terminal and server end are handed over mutuallyMutually to realize obtaining of program-related information.

Claims (10)

1. a method of obtaining TV programme relevant information, is characterized in that, comprising:
The TV program information of mobile terminal receive generation of vibration obtains instruction;
Record the audio frequency of the TV programme of playing;
Send TV programme matching request by remote interface to server end, wherein, described TV programmeCoupling is specially the coupling of audio-frequency fingerprint;
Receive the TV programme that are associated with the described TV programme of playing that described server end returnsInformation also shows.
2. the method for obtaining TV programme relevant information according to claim 1, is characterized in that:
The audio-frequency fingerprint that carries described audio frequency in described TV programme matching request or generate based on described audio frequency.
3. the method for obtaining TV programme relevant information according to claim 1, is characterized in that:
The duration of described audio frequency is the first duration threshold value of presetting.
4. the method for obtaining TV programme relevant information according to claim 2, is characterized in that,Generating audio-frequency fingerprint based on described audio frequency comprises:
Adopt Short Time Fourier Transform algorithm to process described audio frequency, obtain described audio-frequency fingerprint.
5. the method for obtaining TV programme relevant information according to claim 2, is characterized in that,Described employing Short Time Fourier Transform algorithm is processed, is obtained described audio-frequency fingerprint to described audio frequency and comprises:
According to default sample frequency, one frame of described audio frequency is sampled;
The sampled point of extraction is carried out to Short Time Fourier Transform, to obtain corresponding time-frequency figure;
Calculate the value that amplitude in described time-frequency figure meets preset rules, this value is to there being corresponding time and frequentlyRate;
By hash algorithm, time difference and difference on the frequency between adjacent described value are calculated, described in obtainingThe audio-frequency fingerprint of voice data one frame.
6. the method for obtaining TV programme relevant information according to claim 5, is characterized in that,Frequency range in described time-frequency figure can be carried out cutting according to logarithm, to reduce the audio-frequency fingerprint of described audio frequency.
7. the method for obtaining TV programme relevant information according to claim 1, is characterized in that,The described server end of the described reception TV program information being associated with TV programme current broadcasting that returnAnd comprise after the step showing:
Receive the instruction of sharing described TV program information;
Send the request of sharing described TV program information by remote interface, so that described TV programme letterBreath is shared to the shared platform of request;
Receive the shared object information returning in response to this request.
8. a device that obtains TV programme relevant information, is characterized in that, comprising:
The first receiver module, obtains instruction for the TV program information of mobile terminal receive generation of vibration;
The first acquisition module, for recording the audio frequency of the TV programme of playing;
The first sending module, for sending TV programme matching request by remote interface to server end,Wherein, described TV programme coupling is specially the coupling of audio-frequency fingerprint;
The first display module, for receive described server end that return with described TV Festival of playingThe TV program information that order is associated also shows.
9. a device that obtains TV programme relevant information, is characterized in that, comprising:
The 5th receiver module, please for the TV programme coupling that receives end side transmission by remote interfaceAsk;
Matching module, for by the first corresponding this TV programme matching request audio-frequency fingerprint and its storageThe second audio-frequency fingerprint mates;
Pushing module, has and described the first audio-frequency fingerprint phase for the second audio-frequency fingerprint when its storageCoupling audio-frequency fingerprint time, push described phase in response to this TV programme matching request to described end sideThe TV program information corresponding to the second audio frequency of coupling.
10. a system of obtaining TV programme relevant information, is characterized in that, comprises that having right wantsAsk described in 8 the mobile terminal of device and there is the server end of device described in claim 9, described movementTerminal and server end are mutually mutual to realize obtaining of program-related information.
CN201510993649.2A 2015-12-25 2015-12-25 Method, device and system for acquiring related information of television program Pending CN105611314A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510993649.2A CN105611314A (en) 2015-12-25 2015-12-25 Method, device and system for acquiring related information of television program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510993649.2A CN105611314A (en) 2015-12-25 2015-12-25 Method, device and system for acquiring related information of television program

Publications (1)

Publication Number Publication Date
CN105611314A true CN105611314A (en) 2016-05-25

Family

ID=55990807

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510993649.2A Pending CN105611314A (en) 2015-12-25 2015-12-25 Method, device and system for acquiring related information of television program

Country Status (1)

Country Link
CN (1) CN105611314A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108184143A (en) * 2016-12-08 2018-06-19 腾讯科技（深圳）有限公司 Obtain the method and device of resource
CN108271073A (en) * 2016-12-28 2018-07-10 上海昕丝文化传播有限公司 SDK flow chart of data processing
WO2022142650A1 (en) * 2020-12-29 2022-07-07 深圳Tcl数字技术有限公司 Video recording-based information pushing method, smart television, and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011092244A1 (en) * 2010-01-27 2011-08-04 Koninklijke Kpn N.V. Method, system and device for synchronization of media streams
CN102843599A (en) * 2012-09-27 2012-12-26 北京导视互动网络技术有限公司 Interaction method and system of television program
CN103139608A (en) * 2013-01-21 2013-06-05 北京十分科技有限公司 Remote media playing signal time delay test method and test system
CN104994402A (en) * 2015-07-13 2015-10-21 北京奇虎科技有限公司 Method, device and system for acquiring audio/video program relevant information

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011092244A1 (en) * 2010-01-27 2011-08-04 Koninklijke Kpn N.V. Method, system and device for synchronization of media streams
CN102843599A (en) * 2012-09-27 2012-12-26 北京导视互动网络技术有限公司 Interaction method and system of television program
CN103139608A (en) * 2013-01-21 2013-06-05 北京十分科技有限公司 Remote media playing signal time delay test method and test system
CN104994402A (en) * 2015-07-13 2015-10-21 北京奇虎科技有限公司 Method, device and system for acquiring audio/video program relevant information

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108184143A (en) * 2016-12-08 2018-06-19 腾讯科技（深圳）有限公司 Obtain the method and device of resource
CN108271073A (en) * 2016-12-28 2018-07-10 上海昕丝文化传播有限公司 SDK flow chart of data processing
WO2022142650A1 (en) * 2020-12-29 2022-07-07 深圳Tcl数字技术有限公司 Video recording-based information pushing method, smart television, and storage medium

Similar Documents

Publication Publication Date Title
CN104899768B (en) Winnings information production method, Apparatus and system
CN105447103B (en) Red packet orients distribution method, apparatus and system
US8806518B2 (en) Performance analysis for combining remote audience responses
US10021457B2 (en) System and method for engaging a person in the presence of ambient audio
CN104135667B (en) Video remote explanation synchronization method, terminal equipment and system
CN104584571B (en) Audio-frequency fingerprint sequence is produced at set top box
CN104994402A (en) Method, device and system for acquiring audio/video program relevant information
CN102905172B (en) The method of television audience rating data acquisition, internet terminal, server and system
CN102833596B (en) Information transmitting method and device
CN105450778A (en) Information push system
WO2014082353A1 (en) Method and device for identifying frequency channel
CN103108229A (en) Method for identifying video contents in cross-screen mode through audio frequency
CN108900855B (en) Live content recording method and device, computer readable storage medium and server
US20190245635A1 (en) Single-source cross-platform media measurement arrangement, device and related methods
CN112995759A (en) Interactive service processing method, system, device, equipment and storage medium
CN109509472A (en) Method, apparatus and system based on voice platform identification background music
CN112969093B (en) Interactive service processing method, device, equipment and storage medium
US20180123713A1 (en) System and method for participants to perceivably modify a performance based on vital signs
CN104185040A (en) Application synchronization method, application server and terminal
CN105611314A (en) Method, device and system for acquiring related information of television program
CN102833595A (en) Method and apparatus for transferring information
CN103425105B (en) Vehicle-mounted networking terminal and using method thereof based on cloud service
CN110659006B (en) Cross-screen display method and device, electronic equipment and readable storage medium
CN110198452B (en) Live video previewing method, device and system
CN115866280A (en) Live webcast user behavior analysis method, device and equipment based on big data

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20160525