CN110446060A - Media information recognition methods, exchange method and the equipment of TV - Google Patents
Media information recognition methods, exchange method and the equipment of TV Download PDFInfo
- Publication number
- CN110446060A CN110446060A CN201810413921.9A CN201810413921A CN110446060A CN 110446060 A CN110446060 A CN 110446060A CN 201810413921 A CN201810413921 A CN 201810413921A CN 110446060 A CN110446060 A CN 110446060A
- Authority
- CN
- China
- Prior art keywords
- setting
- coding
- acoustic coding
- sound
- audio stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/812—Monomedia components thereof involving advertisement data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/835—Generation of protective data, e.g. certificates
- H04N21/8358—Generation of protective data, e.g. certificates involving watermark
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present invention provides the media information recognition methods of TV, TV interactive operation method, TV, computer readable storage medium and computer equipment, which includes: the audio stream that Capture TV plays, and extracts acoustic coding from the audio stream；The acoustic coding is compared with setting coding；Under comparison result unanimous circumstances, the acoustic coding is exported, to obtain setting media information according to the acoustic coding；The setting coding is associated with the setting media information in advance.The present invention can media information in automatic identification TV, and the shown commodity of advertisement are subjected to down online lower water conservancy diversion, allow spectators more easily to buy, improve user and watch buying experience.
Description
Technical field
The present invention relates to the media information recognition methods of TV technology more particularly to a kind of TV, TV interaction behaviour
Make method, TV, computer readable storage medium and computer equipment.
Background technique
Advertisement can be inserted in the TV programme played on TV, can show the contents such as commodity or activity in advertisement.Such as
Fruit user wishes the commodity that purchase is seen or the activity that participation is seen, can be realized by way of sending short messages, making a phone call.With
The progress of technology, user can also include the two dimensional code of merchandise news or action message by what is shown on scanning TV, and lead to
It crosses adding products in shopping cart using APP (application program) on mobile phone to be bought, or is participated in accordingly on mobile phone
Activity.Anyway, due to televise at present video when can not automatic identification advertisement or activity, so, interacted with TV
Mode requires user using mobile phone every time and carries out sequence of operations, bothers user and watches TV programme, to reduce user
Experience.
Summary of the invention
The present invention provides the media information recognition methods of a kind of TV, TV interactive operation method, TV, computer-readable
Storage medium and computer equipment improve viewing TV Festival with the media information in automatic identification TV, such as advertisement or activity
Purpose user experience.
The embodiment of the present invention provides a kind of media information recognition methods of TV, comprising: the audio stream that Capture TV plays,
And acoustic coding is extracted from the audio stream；The acoustic coding is compared with setting coding；It is consistent in comparison result
In the case where, the acoustic coding is exported, to obtain setting media information according to the acoustic coding；The setting coding is preparatory
It is associated with the setting media information.
In one embodiment, the acoustic coding is compared with setting coding, comprising: receive under coded samples library
The setting coding carried, the coded samples lab setting is in the TV or a server；Compare the acoustic coding and institute
State setting coding.
In one embodiment, the acoustic coding is compared with setting coding, comprising: send the acoustic coding
To a server, to compare the acoustic coding and setting coding using the server, the setting code storage exists
In coded samples library, the coded samples lab setting is in the server.
In one embodiment, acoustic coding is extracted from the audio stream, comprising: sound water is extracted from the audio stream
Print；The sound watermark is pre-generated according to the acoustic coding and is previously implanted the corresponding media resource of the audio stream
In；It interprets to obtain the acoustic coding according to the sound watermark.
In one embodiment, acoustic coding is extracted from the audio stream, comprising: it is special that sound is extracted from the audio stream
Sign；The acoustic coding is searched in corresponding table of the sound characteristic pre-established with acoustic coding according to the sound characteristic.
In one embodiment, the media information recognition methods of the TV further include: before media resource operation, utilize a clothes
Device be engaged in from media resource extraction acoustic information, the acoustic information is converted into setting and is encoded, and is set what is be converted to
Code storage is determined into coded samples library；The media resource includes the audio stream televised.
In one embodiment, the media information recognition methods of the TV further include: before media resource operation, utilize a clothes
Business device intercepts the sound of at least one section setting time length from the media resource, at least one section of setting time length
Sound carry out feature extraction, the result for being characterized extraction establishes unique encodings, and according to the result of the feature extraction and institute
State the unique encodings generation sound characteristic and the corresponding table of acoustic coding；The media resource includes the audio stream.
The embodiment of the present invention also provides a kind of TV interactive operation method, comprising: captures the TV using the SDK of TV
The audio stream of broadcasting, and acoustic coding is extracted from the audio stream；The acoustic coding and setting are encoded using the SDK
It is compared；Under comparison result unanimous circumstances, the SDK exports the acoustic coding；The TV is according to the institute of output
It states acoustic coding and obtains setting media information, and show interactive information corresponding with the setting media information, passed through with obtaining
The user's operation information for the interactive information that remote controler returns；Setting coding in advance with the setting media information
Association.
The embodiment of the present invention also provides a kind of TV, including SDK, and the SDK, which is performed, realizes the various embodiments described above institute
The step of method stated.
The embodiment of the present invention also provides a kind of computer readable storage medium, is stored thereon with computer program, the program
The step of the various embodiments described above the method is realized when being executed by processor.
The embodiment of the present invention also provides a kind of computer equipment, including memory, processor and storage are on a memory simultaneously
The computer program that can be run on a processor, the processor realize the various embodiments described above the method when executing described program
The step of.
Media information recognition methods, TV interactive operation method, TV, the computer-readable storage of the TV of the present embodiment
Medium and computer equipment, the audio stream played by Capture TV, extract acoustic coding from the audio stream, by the sound
Sound coding is compared with setting coding, and the acoustic coding is exported under comparison result unanimous circumstances, according to described
Acoustic coding can obtain setting media information, can realize the media information in automatic identification TV, energy based on sound with this
Enough user experiences for improving viewing TV programme.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.In the accompanying drawings:
Fig. 1 is the flow diagram of the media information recognition methods of the TV of one embodiment of the invention；
Fig. 2 is the method flow schematic diagram that acoustic coding is compared with setting coding in one embodiment of the invention；
Fig. 3 is the method flow schematic diagram for extracting acoustic coding in another embodiment of the present invention from audio stream；
Fig. 4 is the method flow schematic diagram for extracting acoustic coding in further embodiment of this invention from audio stream；
Fig. 5 is the flow diagram of the TV interactive operation method of one embodiment of the invention.
Specific embodiment
Understand in order to make the object, technical scheme and advantages of the embodiment of the invention clearer, with reference to the accompanying drawing to this hair
Bright embodiment is described in further details.Here, the illustrative embodiments of the present invention and their descriptions are used to explain the present invention, but simultaneously
It is not as a limitation of the invention.
Fig. 1 is the flow diagram of the media information recognition methods of the TV of one embodiment of the invention.As shown in Figure 1, should
The media information recognition methods of TV, it may include:
Step S110: the audio stream that Capture TV plays, and acoustic coding is extracted from the audio stream；
Step S120: the acoustic coding is compared with setting coding；
Step S130: under comparison result unanimous circumstances, exporting the acoustic coding, to be obtained according to the acoustic coding
To setting media information；The setting coding is associated with the setting media information in advance.
The TV can be smart television.It can be by installing software (such as SDK) real-time Capture TV on TV
The audio stream of broadcasting.Can immediately or delay extract acoustic coding from the audio stream.Setting coding can be stored in advance
In coded samples library, coded samples library can store multiple setting codings.The setting media information can be media resource
Relevant information, such as what is set in particular media asset commodity SKU (keeper unit) or the parameter that sets.The media
Resource can be the resources such as advertisement, activity, can be used for showing on TV.The media resource may come from TV station, view
Frequency website etc..The setting coding can be associated in advance with the setting media information in a server, and be stored in
In the server, or it can store on television.In embodiment, by comparison as a result, similarity value is obtained, such as more than threshold
Value, it is believed that be same acoustic coding, same media information, such as advertisement can be further considered.Above-mentioned steps S110 is extremely
The SDK (Software Development Kit, Software Development Kit) that step S130 is installed using TV is realized.
In the present embodiment, the audio stream played by Capture TV extracts acoustic coding from the audio stream, will be described
Acoustic coding is compared with setting coding, and the acoustic coding is exported under comparison result unanimous circumstances, according to institute
Setting media information can be obtained by stating acoustic coding, can realize the media information in automatic identification TV based on sound with this.
The advertisement in TV can be identified by this method, and the shown commodity of advertisement are subjected to down online lower water conservancy diversion, make spectators more square
Just buy.
Fig. 2 is the method flow schematic diagram that acoustic coding is compared with setting coding in one embodiment of the invention.Such as
Shown in Fig. 2, in above-mentioned steps S120, the acoustic coding is encoded into the method being compared with setting, it may include:
Step 1211: receiving the setting coding downloaded from coded samples library, the coded samples lab setting is in described
TV or a server；
Step 1212: comparing the acoustic coding and the setting encodes.
Coded samples library can store the storage equipment of storage equipment or the server in the TV.Can by institute
It states acoustic coding to be compared with each setting coding in the coded samples library, be compiled if can find and compare consistent setting
Code, then can illustrate that comparison result is consistent.
In embodiment, it is compared on smart television, the acoustic coding in sample database downloads in smart television SDK,
SDK collects the sound in TV in real time, synchronous to carry out acoustic coding comparison, obtains comparison result.
In some embodiments, in above-mentioned steps S120, the acoustic coding is compared with setting coding, can be wrapped
It includes: the acoustic coding is sent to a server, to compare the acoustic coding and setting volume using the server
Code, the setting code storage is in coded samples library, and the coded samples lab setting is in the server.
In embodiment, smart television only acquires sound and is converted to acoustic coding, and acoustic coding is transferred to server end,
The comparison that acoustic coding and sample audio coding are carried out by server end, obtains comparison result.
Fig. 3 is the method flow schematic diagram for extracting acoustic coding in another embodiment of the present invention from audio stream.Such as Fig. 3 institute
Show, in above-mentioned steps S120, extract acoustic coding from the audio stream, it may include:
Step S1221: sound watermark is extracted from the audio stream；The sound watermark is pre- according to the acoustic coding
It first generates and is previously implanted in the corresponding media resource of the audio stream；
Step S1222: it interprets to obtain the acoustic coding according to the sound watermark.
Sound watermark can be by being obtained digital watermark embedding into audio file using watermarking algorithm.The sound
Sound watermark can be generated according to setpoint frequency rule encoding.It can be interpreted according to the feature of setpoint frequency and when implantation complete one
The coding ID of cause.This method for extracting acoustic coding does not need frequently to carry out a large amount of data exchange with server, in SDK
The television at place can realize decoding, and recognition efficiency is higher, and reliability consistency is good.
Fig. 4 is the method flow schematic diagram for extracting acoustic coding in further embodiment of this invention from audio stream.Such as Fig. 4 institute
Show, in above-mentioned steps S120, extract acoustic coding from the audio stream, it may include:
Step S1231: sound characteristic is extracted from the audio stream；
Step S1232: it is looked into corresponding table of the sound characteristic pre-established with acoustic coding according to the sound characteristic
Look for the acoustic coding.
Above-mentioned steps S1231 and step S1232 can use the SDK of installation on television and realize.Specifically, above-mentioned steps
S1231 may include the sound of at least one section setting time length being intercepted from the audio stream, and carry out to the sound of interception special
Sign is extracted.In above-mentioned steps S1232, in corresponding table of the sound characteristic pre-established with acoustic coding, sound characteristic harmony
Sound coding corresponds, and finds the sound characteristic, the acoustic coding can be obtained.This side for extracting acoustic coding
Method, it may not be necessary to media resource (such as program or advertisement video) be operated in advance, directly carried out using original audio
Feature Conversion reaches interactive purpose, but identification has certain time-delay.
It is raw in the media information recognition methods of the TV of each embodiment in above-mentioned steps S1231 in some embodiments
At the method for the sound characteristic and the corresponding table of acoustic coding, it may include: before media resource operation, utilize a server
The sound that at least one section setting time length is intercepted from the media resource, to the sound of at least one section setting time length
Sound carries out feature extraction, and the result for being characterized extraction establishes unique encodings, and according to the result of the feature extraction and it is described only
One encodes the sound characteristic described in generating and the corresponding table of acoustic coding；The media resource includes the audio stream.
The setting time length is, for example, to be greater than or equal to 3 seconds, and 3 seconds or more extraction results are reliable.Above-mentioned correspondence
The method of table is generated and is stored in a server, which has the function of processing, storage etc., and present position is not made
It limits.
In some embodiments, in the media information recognition methods of the TV of each embodiment, the generation method in coded samples library,
Can include: before media resource operation, acoustic information is extracted from the media resource using a server, by the acoustic information
Setting coding is converted to, and by the setting code storage being converted into coded samples library；The media resource includes described
The audio stream televised.Media resource for example can be advertisement or movable video, audio etc..
Based on the media information recognition methods with above-mentioned TV, the embodiment of the present invention also provides a kind of TV interactive operation side
Method.
Fig. 5 is the flow diagram of the TV interactive operation method of one embodiment of the invention, as shown in figure 5, the TV is handed over
Mutual operation method, it may include:
Step S210: the audio stream televised described in the SDK capture using TV, and the extraction sound from the audio stream
Sound coding；
Step S220: the acoustic coding is compared with setting coding using the SDK；
Step S230: under comparison result unanimous circumstances, the SDK exports the acoustic coding；
Step S240: the TV according to the acoustic coding of output obtain setting media information, and show with it is described
The corresponding interactive information of media information is set, is believed with obtaining by the user's operation for the interactive information that remote controler returns
Breath；The setting coding is associated with the setting media information in advance.
The specific embodiment of above-mentioned steps S210 to step S230 can refer to above-mentioned media information recognition methods and learns, therefore
This is repeated no more again.In above-mentioned steps S240, related information of the setting coding in advance with the setting media information can be with
It generates, is can store in the storage equipment of TV except TV, or be stored on a server and (TV need to be reached).When this
When setting media information as advertising information, which can be the button of confirmation shopping；When this sets media information as ginseng
When with the information of television activity, which can be the button for participating in ballot.For the user's operation of the interactive information
Information, which for example can be, presses acknowledgement key or cancel key by remote controler.
The embodiment of the present invention also provides a kind of TV, including SDK (being mounted with SDK), the SDK be performed realize it is above-mentioned
The step of media information recognition methods of TV described in each embodiment.
The embodiment of the present invention also provides a kind of computer readable storage medium, is stored thereon with computer program, the program
The step of the various embodiments described above the method is realized when being executed by processor.
The embodiment of the present invention also provides a kind of computer equipment, including memory, processor and storage are on a memory simultaneously
The computer program that can be run on a processor, the processor realize the various embodiments described above the method when executing described program
The step of.
In one embodiment, TV interactive operation method, it may include:
Step S310: the audio stream that Capture TV plays；
Step S320: setting acoustic coding is obtained from the audio stream, and triggers the TV and shows the setting sound
Sound encodes the event of corresponding interactive information；The setting acoustic coding is associated with the interactive information in advance；
Step S330: it is sent according to the operation information returned for the interactive information comprising the ID of the TV and described
The operation requests information of acoustic coding relevant information is set, on the user account of the corresponding application of the setting acoustic coding
Complete the operation of the corresponding operation requests information；The operation information is that user is returned by the remote controler of the TV.
In above-mentioned steps S310, the audio stream that real-time Capture TV plays can be, for example, using pacifying in smart television
The SDK of dress captures the audio stream in the played video of the smart television.
In above-mentioned steps S320, setting acoustic coding can be obtained from the audio stream in a number of different ways.
For example, obtaining the setting acoustic coding by the sound watermark for being previously implanted video, or should by extracting sound characteristic acquisition
Set acoustic coding.Specifically, audio stream can be listened to by SDK, and extracts to obtain setting acoustic coding by phonetic analysis.
Above-mentioned interactive information for example can be shopping information, ballot activity etc..Interactive information is, for example, advertising information, ballot activity etc..
Various setting acoustic codings can before advertisement or program broadcast in advance with setting commodity SKU or parameter association.Once identifying
Associated setting acoustic coding can trigger corresponding event, and the event of triggering, which can carry interactive information and be sent to TV, to be set
Standby, television equipment can show the interactive information, such as commodity are added to button, the ballot button etc. of shopping cart.The ID of TV
Such as it can be the unique identification ID being made of codings such as MAC Address, Android Id, TV accounts.
Step S330: operation information is, for example, to confirm information, confirmation ballot that commodity are added to shopping cart (optional quantity)
Information etc..The application is, for example, shopping APP, social media etc..Setting acoustic coding relevant information can be the setting sound
The merchandise news etc. of coding or the corresponding setting acoustic coding.The server for receiving the operation requests information can be according to TV
ID and setting acoustic coding search the correspondence of pre-stored TV ID (mark of TV), setting acoustic coding and application
Table, find and meanwhile with the ID of the ID of the TV and the corresponding application of the setting acoustic coding, thus with the ID of application into
The operation information is handed down to user account by the application ID, completes corresponding operating, such as shopping cart, quotient is added by row interaction
Product such as place an order, vote at the operation.In other embodiments, it can first be tabled look-up according to the ID of TV and find multiple applications, according to setting
Acoustic coding finds corresponding application from multiple application.In other embodiments, can television complete search simultaneously with
The process of the ID of the TV and the ID of the corresponding application of the setting acoustic coding.Operation requests information can also include other
The information that may be needed.
According to setting rule, the corresponding interactive information of the setting acoustic coding is shown；The interactive information is interaction two
Tie up code or information alert button.
In some embodiments, the interactive information includes: two dimensional code, carries the TV ID and the setting sound is compiled
Code；The two dimensional code with user for interact and jumping as URL, to pass through the URL transmission TV ID and the setting
Acoustic coding, to bind the ID of the TV ID and the application.
In some embodiments, in above-mentioned steps S320, the specific implementation of setting acoustic coding is obtained from the audio stream
Mode, it may include: sound watermark is identified from the audio stream, and setting acoustic coding is obtained by the sound watermark；Institute
Stating sound watermark is pre-generated according to setpoint frequency rule encoding and is previously implanted in audio corresponding to the audio stream.
In some embodiments, in above-mentioned steps S320, the method that setting acoustic coding is obtained from the audio stream can be wrapped
It includes:
Step S321: at least one setting sound characteristic is extracted from the audio stream；
Step S322: it is corresponding that at least one described setting sound characteristic is searched in corresponding table of the sound characteristic with coding
Coding, and setting acoustic coding is obtained according to the coding found；The sound characteristic is to pre-establish with the corresponding table of coding
's.
In some embodiments, the TV interactive operation method, it may include:
Step S410: the operation requests information of the ID comprising TV and setting acoustic coding relevant information are received；The behaviour
It as solicited message is sent according to operation information；The operation information is user by the remote controler of the TV and for mutual
What dynamic information returned；The interactive information is to be shown by the TV and corresponding with the setting acoustic coding；The setting
Acoustic coding is obtained from the audio stream televised；The setting acoustic coding is closed with the interactive information in advance
Connection；
Step S420: the setting acoustic coding relevant information is sent to according to the operation requests information and is set with described
Determine the user account of the corresponding application of acoustic coding；The application is bound with the ID of the TV.
In some embodiments, before above-mentioned steps S420, that is, according to the operation requests information by the setting sound
Code-related information is sent to before the user account of application corresponding with the setting acoustic coding, may also include that step
S430: interacting with the application, and the ID of the TV and the ID of the application are bound.
The embodiment of the present invention also provides a kind of TV interactive operating system.The TV interactive operating system, it may include:
SDK 510, is used for: the audio stream that Capture TV plays；Setting acoustic coding is obtained from the audio stream, and is touched
Send out TV described and show the event of the corresponding interactive information of the setting acoustic coding；The setting acoustic coding in advance with it is described
Interactive information association；The ID comprising the TV and the setting are sent according to the operation information returned for the interactive information
The operation requests information of acoustic coding relevant information；
The TV 520, is used for: the corresponding interactive information of the display setting acoustic coding, and receives user and pass through institute
State the operation information that the remote controler of TV returns；
Server 530, is used for: receiving the operation requests information, and according to the operation requests information by the setting
Acoustic coding relevant information is sent to the user account of application corresponding with the setting acoustic coding；The ID of the application with
The ID of the TV is bound.
In some embodiments, the interactive information can include: two dimensional code carries the ID and the setting sound of the TV
Coding carries the TV ID and the setting acoustic coding for making customer mobile terminal jump URL；The server 530,
It is also used to: receiving the TV ID and the setting acoustic coding that the URL is carried, and interacted with the application, with binding
The ID of the TV ID and the application.
In embodiment, smart television, can have operating system, mountable software TV or OTT (Over The Top,
Internet television) box.SDK, it is mountable on television, the sightless system-Level software of user can obtain the sound of television set
Sound feature switchs to acoustic coding, i.e., the sound watermark feature that can't hear of human ear, SDK itself can interpret watermark encoder.Sound water
Code database is printed, commodity corresponding to the watermark encoder and watermark encoder of the advertisement of media side or program or movable volume can be stored
Code, to specify content corresponding specified commodity or activity when video interactive.Code database, storage media side's advertisement this sample sound are compiled
Code, the advertisement that advertiser is provided are extracted voice sounds, are put into sample database, for transferring.Media side, can be TV station or
Video website etc. can be to provide the media resource side of advertising display.It, can be according to the ginseng of SDK transmitting after smart television upgrades SDK
Number, the on the screen corresponding prompt of display.User can carry out corresponding operation according to the prompt on TV.
For identifying advertisement or content on smart television, the implementing procedure for the method that user interacts with TV can be with
Including following one or more steps；
1, a SDK is installed on smart television, it can real-time Capture TV audio stream.
2, the implementation method that acoustic coding is extracted after acquisition television audio stream, can be aggressive mode or Passive Mode:
A) aggressive mode, advertisement or program broadcast preceding in corresponding video, the sound watermark of implantation specific frequency rule.Root
According to uniform rules, after the sound watermark that a coding generates is implanted into one section of video ads or content, it is being mounted with SDK of the invention
When smart television broadcasts this section of video ads or content, SDK can be reversed complete when being interpreted by frequency rule feature with implantation
Complete consistent coding ID.The benefit of this way is that recognition efficiency is higher, and reliability consistency is good, do not need frequently with service
A large amount of data exchange is carried out, can realize decoding in the television where SDK.
B) Passive Mode is needing interaction without any specially treated in the video that end is broadcasted in advertisement or program
Intercepted length is no less than 3 seconds sound in video, can be one or more snippets, and the sound of interception is carried out feature extraction and a pair
One establishes unique encodings, and the sound characteristic of extraction and corresponding coding schedule are issued in smart television, and hereafter the SDK in television set is real
When listen to audio stream, when the program of television for play or ad sound feature consistent with the characteristic segments prestored, SDK passes through correspondence
Coding schedule finds coding.The advantage of doing so is that, it may not be necessary to program or advertisement video are operated in advance, directly benefit
Feature Conversion is carried out with original audio and reaches interactive purpose, the disadvantage is that identification has certain time-delay, needing to compare for 3 seconds or more can
It leans on.
It 3, (may be by MAC by television set ID by the triggering rule being previously set after obtaining corresponding encoded
The unique identification ID of the codings such as location, Android Id, TV account composition) it is edited and released with the sound identified and gives television set,
TV show interact two dimensional code or other cue buttons on the tv screen i.e. according to prefabricated rule, provide user into
Row interaction in next step.
If 4, no and this smart television ID was bound before the corresponding APP of user mobile phone, TV two-dimensional code display,
TV ID and audio coding can be carried in two dimensional code, these parameters can be jumped URL by two dimensional code and be carried in interaction, be sent to
Server, server passes through and other third parties interaction, and TV ID and third party ID is bound, is later sent to audio coding
Corresponding third party's Account interface system.
If 5, for user mobile phone with the smart television binding of implantation SDK, it is true that TV directly displays television set key
Recognize prompt, it is no longer necessary to which the audio coding identified with mobile phone interaction, TV is directly transmitted with TV ID and audio volume
To server, server is docked according to default rule with third-party platform for the request of code.For example a quotient is seen on TV
The advertisement of product, shopping cart is added by remote controler confirmation part in prompt on TV, and spectators press acknowledgement key, this part commodity with TV remote controller
Automatically into the shopping cart of third party's electric business spectators app oneself account.Or spectators see ballot or interaction prompts, also only need
TV remote controller operation is used, the feedback of this operation corresponds in the account of app to user automatically to be translated, without every time
Two dimensional code interaction is carried out with mobile phone.
SDK of the invention is implanted into smart television, SDK can listen to sound stream, extract acoustic coding, sound by phonetic analysis
Sound coding can be associated with the commodity SKU or parameter association set with prior, when television broadcasts video, once identification is associated
Acoustic coding will trigger corresponding event, and event can carry SKU or parameter is sent to television equipment, and TV and equipment show phase
The prompt answered.Spectators see prompt, if there is buying or participating in the demand of interaction, it is only necessary to press by TV remote controller confirmation
Button, request can be dealt into server-side and be compared later, if this TV does not bind the mobile phone of spectators, need to carry out primary
Binding, some app account in smart television ID (authentication) and mobile phone is bound, the quotient that spectators see on TV after binding
Product order or action message can be issued to automatically on the mobile phone of spectators, by information while leaving the viewing of spectators' television content alone
Water conservancy diversion is completed in mobile phone side, and spectators is allowed more easily to carry out the commodity in purchase television advertising, or participates in TV interaction activity.
The present invention provides the methods that advertisement or content are accurately identified on smart television, and advertisement or content are shown
Commodity or activity directly interact by TV remote controller, without using mobile phone to interact with TV every time, interaction itself
It can be and add commodity from trend spectators' cell phone application shopping cart by TV remote controller, can also seen by TV remote controller
The detachable lining of many mobile phone social media accounts participates in ballot or interaction.
In conclusion the media information recognition methods of the TV of the present embodiment, TV interactive operation method, TV, calculating
Machine readable storage medium storing program for executing and computer equipment, the audio stream played by Capture TV extract sound from the audio stream and compile
The acoustic coding is compared with setting coding, and exports the sound under comparison result unanimous circumstances and compile by code
Code can obtain setting media information according to the acoustic coding, can be realized in automatic identification TV based on sound with this
Media information can be improved the user experience of viewing TV programme.
In the description of this specification, reference term " one embodiment ", " specific embodiment ", " some implementations
Example ", " such as ", the description of " example ", " specific example " or " some examples " etc. mean it is described in conjunction with this embodiment or example
Particular features, structures, materials, or characteristics are included at least one embodiment or example of the invention.In the present specification,
Schematic expression of the above terms may not refer to the same embodiment or example.Moreover, the specific features of description, knot
Structure, material or feature can be combined in any suitable manner in any one or more of the embodiments or examples.Each embodiment
Involved in the step of sequence be used to schematically illustrate implementation of the invention, sequence of steps therein is not construed as limiting, can be as needed
It appropriately adjusts.
It should be understood by those skilled in the art that, the embodiment of the present invention can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the present invention, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Particular embodiments described above has carried out further in detail the purpose of the present invention, technical scheme and beneficial effects
Describe in detail it is bright, it should be understood that the above is only a specific embodiment of the present invention, the guarantor being not intended to limit the present invention
Range is protected, all within the spirits and principles of the present invention, any modification, equivalent substitution, improvement and etc. done should be included in this
Within the protection scope of invention.
Claims (11)
1. a kind of media information recognition methods of TV characterized by comprising
The audio stream that Capture TV plays, and acoustic coding is extracted from the audio stream；
The acoustic coding is compared with setting coding；
Under comparison result unanimous circumstances, the acoustic coding is exported, to obtain setting media letter according to the acoustic coding
Breath；The setting coding is associated with the setting media information in advance.
2. the media information recognition methods of TV as described in claim 1, which is characterized in that by the acoustic coding and setting
Coding is compared, comprising:
The setting coding downloaded from coded samples library is received, the coded samples lab setting is serviced in the TV or one
Device；
It compares the acoustic coding and the setting encodes.
3. the media information recognition methods of TV as described in claim 1, which is characterized in that by the acoustic coding and setting
Coding is compared, comprising:
The acoustic coding is sent to a server, to compare the acoustic coding and setting volume using the server
Code, the setting code storage is in coded samples library, and the coded samples lab setting is in the server.
4. the media information recognition methods of TV as described in claim 1, which is characterized in that the extraction sound from the audio stream
Sound coding, comprising:
Sound watermark is extracted from the audio stream；The sound watermark is pre-generated and preparatory according to the acoustic coding
It is implanted into the corresponding media resource of the audio stream；
It interprets to obtain the acoustic coding according to the sound watermark.
5. the media information recognition methods of TV as described in claim 1, which is characterized in that the extraction sound from the audio stream
Sound coding, comprising:
Sound characteristic is extracted from the audio stream；
The acoustic coding is searched in corresponding table of the sound characteristic pre-established with acoustic coding according to the sound characteristic.
6. the media information recognition methods of TV as claimed in claim 2 or claim 3, which is characterized in that further include:
Before media resource operation, acoustic information is extracted from the media resource using a server, the acoustic information is turned
It is changed to setting coding, and by the setting code storage being converted into coded samples library；The media resource includes the electricity
Depending on the audio stream played.
7. the media information recognition methods of TV as claimed in claim 5, which is characterized in that further include:
Before media resource operation, the sound of at least one section setting time length is intercepted from the media resource using a server
Sound carries out feature extraction to the sound of at least one section setting time length, and the result for being characterized extraction establishes unique encodings,
And according to the result of the feature extraction and the unique encodings generation sound characteristic and the corresponding table of acoustic coding；Institute
Stating media resource includes the audio stream.
8. a kind of TV interactive operation method characterized by comprising
The audio stream televised described in SDK capture using TV, and acoustic coding is extracted from the audio stream；
The acoustic coding is compared with setting coding using the SDK；
Under comparison result unanimous circumstances, the SDK exports the acoustic coding；
The TV obtains setting media information according to the acoustic coding of output, and shows and the setting media information pair
The interactive information answered, to obtain the user's operation information for the interactive information returned by remote controler；The setting is compiled
Code is associated with the setting media information in advance.
9. a kind of TV, which is characterized in that including SDK, the SDK is performed the method realized as described in claim 1 to 5
The step of.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
The step of claim 1 to 8 the method is realized when execution.
11. a kind of computer equipment including memory, processor and stores the meter that can be run on a memory and on a processor
Calculation machine program, which is characterized in that the step of processor realizes claim 1 to 8 the method when executing described program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810413921.9A CN110446060A (en) | 2018-05-03 | 2018-05-03 | Media information recognition methods, exchange method and the equipment of TV |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810413921.9A CN110446060A (en) | 2018-05-03 | 2018-05-03 | Media information recognition methods, exchange method and the equipment of TV |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110446060A true CN110446060A (en) | 2019-11-12 |
Family
ID=68428024
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810413921.9A Pending CN110446060A (en) | 2018-05-03 | 2018-05-03 | Media information recognition methods, exchange method and the equipment of TV |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110446060A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110174137A1 (en) * | 2010-01-15 | 2011-07-21 | Yamaha Corporation | Tone reproduction apparatus and method |
| CN103024581A (en) * | 2012-12-26 | 2013-04-03 | Tcl集团股份有限公司 | Smart television and program interaction implementation method and program interaction implementation system thereof |
| CN103402118A (en) * | 2013-07-05 | 2013-11-20 | Tcl集团股份有限公司 | Media program interaction method and system |
| CN105392022A (en) * | 2015-11-04 | 2016-03-09 | 北京符景数据服务有限公司 | Audio watermark-based information interaction method and device |
| CN106162321A (en) * | 2016-08-31 | 2016-11-23 | 成都广电视讯文化传播有限公司 | The audio signal identification method that a kind of vocal print feature and audio frequency watermark combine |
-
2018
- 2018-05-03 CN CN201810413921.9A patent/CN110446060A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110174137A1 (en) * | 2010-01-15 | 2011-07-21 | Yamaha Corporation | Tone reproduction apparatus and method |
| CN103024581A (en) * | 2012-12-26 | 2013-04-03 | Tcl集团股份有限公司 | Smart television and program interaction implementation method and program interaction implementation system thereof |
| CN103402118A (en) * | 2013-07-05 | 2013-11-20 | Tcl集团股份有限公司 | Media program interaction method and system |
| CN105392022A (en) * | 2015-11-04 | 2016-03-09 | 北京符景数据服务有限公司 | Audio watermark-based information interaction method and device |
| CN106162321A (en) * | 2016-08-31 | 2016-11-23 | 成都广电视讯文化传播有限公司 | The audio signal identification method that a kind of vocal print feature and audio frequency watermark combine |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103369363B (en) | The control method of a kind of application program, system and device | |
| CN105392022B (en) | Information interacting method and device based on audio frequency watermark | |
| CN112087655B (en) | Method and device for presenting virtual gift and electronic equipment | |
| CN108462883B (en) | A kind of living broadcast interactive method, apparatus, terminal device and storage medium | |
| EP2918026A1 (en) | Improvements relating to audio visual interfaces | |
| US20090265022A1 (en) | Playback of multimedia during multi-way communications | |
| CN102176197A (en) | Method for performing real-time interaction by using virtual avatar and real-time image | |
| CN101606171A (en) | The apparatus and method of access and first media data correlation combiner information | |
| CN108171160B (en) | Task result identification method and device, storage medium and electronic equipment | |
| CA2890486C (en) | Methods and apparatus to identify media | |
| WO2013040904A1 (en) | Advertisement processing method and terminal | |
| CN105916051A (en) | Content recommendation method and device | |
| CN111966441A (en) | Information processing method and device based on virtual resources, electronic equipment and medium | |
| CN105916044A (en) | Method and system of mobile Internet interaction lottery realization of TV program | |
| CN113365094A (en) | Live broadcast-based push stream data processing method, computing device and storage medium | |
| CN101179698B (en) | Interdynamic television play device and system, play method | |
| CN106375784A (en) | Method and apparatus for commenting program and receiving comment information of program | |
| CN105744338B (en) | A kind of method for processing video frequency and its equipment | |
| CN114501103A (en) | Interaction method, device and equipment based on live video and storage medium | |
| CN105635841A (en) | Interaction broadcast control method and system | |
| CN105120319A (en) | Method for pushing interaction information of television interaction system | |
| CN110446060A (en) | Media information recognition methods, exchange method and the equipment of TV | |
| CN108958803A (en) | A kind of information processing method, terminal device, system and storage medium | |
| CN110446088A (en) | Media information recognition methods, exchange method and the equipment of TV | |
| CN110503509A (en) | A kind of method, apparatus of interaction calculates equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191112 |
|
| RJ01 | Rejection of invention patent application after publication |