CN106341728A - Product information displaying method, apparatus and system in video - Google Patents

Product information displaying method, apparatus and system in video Download PDF

Info

Publication number
CN106341728A
CN106341728A CN201610915656.5A CN201610915656A CN106341728A CN 106341728 A CN106341728 A CN 106341728A CN 201610915656 A CN201610915656 A CN 201610915656A CN 106341728 A CN106341728 A CN 106341728A
Authority
CN
China
Prior art keywords
audio frequency
video
product information
period
ultrasound wave
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610915656.5A
Other languages
Chinese (zh)
Inventor
苗峻
刘翔宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Patrol Sound Image Technology Service Co Ltd
Original Assignee
Beijing Patrol Sound Image Technology Service Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Patrol Sound Image Technology Service Co Ltd filed Critical Beijing Patrol Sound Image Technology Service Co Ltd
Priority to CN201610915656.5A priority Critical patent/CN106341728A/en
Publication of CN106341728A publication Critical patent/CN106341728A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • H04N21/4394Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/47815Electronic shopping

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the invention provides a product information displaying method, apparatus and system in a video, and relates to the audio technical field. The method comprises the steps of continuously receiving audio played by the first terminal when the video is played, and obtaining the product information corresponding to the sound for displaying based on the audio and the correspondence between the product information in the video for each of the preset playing time periods and the audio of the corresponding playing time period. According to the scheme provided in the invention, audio is played during the process when a first terminal plays video, a second terminal receives the audio corresponding to the video during the video playing process, and then the product information corresponding to the sound is obtained for displaying based on the audio and the correspondence between the product information in the video for each of the preset playing time periods and the audio of the corresponding playing time period. In the process, the product information display and video playing can be coaxial. If a user, while watching the video, wants to know the information of a product, the user only needs to watch the product information currently displayed on the first terminal, and searching on the internet is not needed. The operation is simple and fast.

Description

A kind of product information methods of exhibiting in video, device and system
Technical field
The present invention relates to Audiotechnica field, product information methods of exhibiting in more particularly to a kind of video, device and System.
Background technology
In order to enrich the life of people, occur in that various videos, such as various TV plays, film etc., Ren Menke To watch video in the various terminals such as TV, computer, panel computer, mobile phone.
In the playing process as TV play for the video, the personage of the inside may use various products, such as footwear, bag, mobile phone, Car etc., but in the playing process of TV play, user may only see this product article appearance it is not known that specific product is believed Breath, such as product price, who produces, where on sale etc., user if it is intended to the product information of certain product, need from Own removal search engine or shopping website retrieval.
Therefore, the process of the product information of product in above-mentioned retrieval video for a user, its complex operation step, User can not see the product information of the product of its concern in time.
Content of the invention
In view of the above problems, the present invention proposes a kind of product information methods of exhibiting in video and corresponding device, is System, it can synchronously show the product information of product in video during video playback.
In order to solve the above problems, the invention discloses the product information methods of exhibiting in a kind of video, comprising:
Persistently receive first terminal and play the audio frequency play during video;
According to described audio frequency, the product information in video based on each broadcasting period default and the corresponding audio frequency playing the period Between corresponding relation, from server obtain the corresponding product information of described sound be shown.
Optionally, also include:
The audio frequency of video is divided into n section by playing the period;
Set up the corresponding relation between the product information in the video of each broadcasting period and the audio frequency of corresponding broadcasting period.
Optionally, between the described product information set up in the video that each plays the period and the corresponding audio frequency playing the period Corresponding relation step, comprising:
Set up between the core product information in the vocal print and the video of corresponding broadcasting period in the audio frequency in each broadcasting period Corresponding relation;
Further, also include:
The audio frequency original position playing the period at each adds different ultrasound wave;
Set up the corresponding pass between the multiple product informations in ultrasound wave and the video of corresponding broadcasting period of each broadcasting period System.
Optionally, described according to described audio frequency, based on default each play product information and phase in the video of period The corresponding relation between the audio frequency of period should be play, obtain, from server, the step that the corresponding product information of described sound is shown Suddenly, comprising:
Parse the ultrasound wave in described audio frequency;
According to described ultrasound wave, based on default each play multiple in the ultrasound wave of period and the video of corresponding broadcasting period Corresponding relation between product information, obtains the plurality of product information to be shown from server;
Using the audio frequency of specified time span longer than the corresponding audio frequency of ultrasound wave, parse vocal print;
According to described vocal print, based in the vocal print and the video of corresponding broadcasting period in the audio frequency in each broadcasting period default Core product information between corresponding relation, obtain described core product information to replace the plurality of product letter from server Breath is shown.
Optionally, the described audio frequency using specified time span longer than the corresponding audio frequency of ultrasound wave, the step of parsing vocal print Before, also include:
The uniquely affiliated video of this ultrasound wave is searched according to described ultrasound wave;
Further, then the described audio frequency using specified time span longer than the corresponding audio frequency of ultrasound wave, the step of parsing vocal print Afterwards, also include:
Described vocal print is mated with each vocal print in the whole audiorange of described video;
If matched, enter according to described vocal print, based on the vocal print in the audio frequency in each broadcasting period default and phase The corresponding relation between the core product information in the video of period should be play, from server obtain described core product information with Replace the step that the plurality of product information is shown.
Optionally, before the step of the ultrasound wave in parsing described audio frequency, also include:
Virtual first mike and a second microphone;
Further, then the step parsing the ultrasound wave in described audio frequency includes:
Obtain audio frequency using the first mike from actual microphone;
Ultrasound wave is parsed from described audio frequency;
Further, then the audio frequency of specified time span longer than the corresponding audio frequency of ultrasound wave, the step of parsing vocal print, bag are utilized Include:
Obtain audio frequency using second microphone from actual microphone;
Vocal print is parsed from described audio frequency.
Optionally, according to described audio frequency, based on default each play product information in the video of period with corresponding Play the corresponding relation between the audio frequency of period, from server obtain the step that is shown of the corresponding product information of described sound it Afterwards, also include:
Corresponding relation between product information according to feedback and reproduction time, in the video of modification vocal print and corresponding broadcasting period Core product information between corresponding relation.
Optionally, obtain the product information play period corresponding video of described audio frequency to be shown from server Step after, also include:
The purchase request of receive user triggering in product information displaying interface, and ask generation purchase to be ordered according to described purchase Single.
The invention also discloses the product information exhibiting device in a kind of video, comprising:
Audio frequency receiver module, is playing, for persistently receiving first terminal, the audio frequency play during video;
Synchronous display module, for according to described audio frequency, based on default each play product information in the video of period with Corresponding relation between the audio frequency of corresponding broadcasting period, obtains the corresponding product information of described sound from server and is shown.
Preferably, also include:
Video division module, for being divided into n section by the audio frequency of video by playing the period;
First relation sets up module, for setting up product information and the corresponding sound playing the period in the video that each plays the period Corresponding relation between frequency.
Preferably, described first relation is set up module and is included:
First relation setting up submodule, plays regarding of period for setting up each vocal print play in the audio frequency in the period with corresponding The corresponding relation between core product information in frequency
Further, also include:
Ultrasound wave add module, the audio frequency original position for playing the period at each adds different ultrasound wave;
Second relation sets up module, multiple in each ultrasound wave playing the period and the video accordingly playing the period for setting up Corresponding relation between product information.
Preferably, described synchronous display module includes:
Ultrasound wave analyzing sub-module, for parsing the ultrasound wave in described audio frequency;
Ultrasound wave shows submodule, for according to described ultrasound wave, based on default each play the ultrasound wave of period with corresponding Play the corresponding relation between the multiple product informations in the video of period, obtain the plurality of product information to enter from server Row is shown;
Common acoustic analyzing sub-module, for the audio frequency using specified time span longer than the corresponding audio frequency of ultrasound wave, parsing sound Stricture of vagina;
Common acoustic shows submodule, for according to described vocal print, based on the sound in the audio frequency in each broadcasting period default The corresponding relation between core product information in the video of stricture of vagina and corresponding broadcasting period, obtains described core product from server Information is shown with replacing the plurality of product information.
Preferably, before described common acoustic analyzing sub-module, also include:
Video determination sub-module, for searching the uniquely affiliated video of this ultrasound wave according to described ultrasound wave;
Further, then, after described common acoustic analyzing sub-module, also include:
Vocal print searches submodule, for carrying out described vocal print and each vocal print in the whole audiorange of described video Join;If matching, entering common acoustic and showing submodule.
Preferably, before ultrasound wave analyzing sub-module, also include:
Virtual first mike and a second microphone;
Mike virtual module, for virtual first mike and a second microphone.
Further, then ultrasound wave analyzing sub-module includes:
First acquisition submodule, for obtaining audio frequency using the first mike from actual microphone;
First analyzing sub-module, for parsing ultrasound wave from described audio frequency;
Further, then common acoustic analyzing sub-module includes:
Second acquisition submodule, for obtaining audio frequency using second microphone from actual microphone;
Second analyzing sub-module, for parsing vocal print from described audio frequency.
Preferably, after described synchronous display module, also include:
Relation modified module, for the corresponding relation between the product information according to feedback and reproduction time, modification vocal print and phase The corresponding relation between the core product information in the video of period should be play.
Preferably, after described synchronous display module, also include:
Buy module, show the purchase request of triggering in interface for receive user in product information, and please according to described purchase Seek survival into purchase order.
The invention also discloses the product information display systems in a kind of video, comprising:
First terminal, second terminal, server;
Described second terminal includes:
Audio frequency receiver module, is playing, for persistently receiving first terminal, the audio frequency play during video;
Synchronous display module, for according to described audio frequency, based on default each play product information in the video of period with Corresponding relation between the audio frequency of corresponding broadcasting period, obtains the corresponding product information of described sound from server and is shown;
Described second terminal is used for playing described video and the audio frequency of described video;
Described server is used for providing described product information.
The scheme providing with respect to prior art, the present invention, plays audio frequency during first terminal plays video, and Second terminal then receive during this video playback to should video audio frequency, then according to described audio frequency, based on default Each play corresponding relation between product information in the video of period and the corresponding audio frequency playing the period, obtain from server The corresponding product information of described sound is taken to be shown.In said process, the displaying of product information can be made same with the broadcasting of video Axle, user is during viewing video if it is desired to know the information of certain part product it is only necessary to watch first terminal current presentation Product information be can be known, go again to scan on network without user, simple to operate, quick.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the technological means of the present invention, And can be practiced according to the content of description, and in order to allow the above and other objects of the present invention, feature and advantage can Become apparent, below especially exemplified by the specific embodiment of the present invention.
Brief description
By reading the detailed description of hereafter preferred implementation, various other advantages and benefit are common for this area Technical staff will be clear from understanding.Accompanying drawing is only used for illustrating the purpose of preferred implementation, and is not considered as to the present invention Restriction.And in whole accompanying drawing, it is denoted by the same reference numerals identical part.In the accompanying drawings:
Fig. 1 shows the FB(flow block) of the product information methods of exhibiting in a kind of video according to an embodiment of the invention;
Fig. 2 shows the FB(flow block) of the product information methods of exhibiting in a kind of video according to an embodiment of the invention;
Fig. 3 shows the FB(flow block) of the product information methods of exhibiting in a kind of video according to an embodiment of the invention;
Fig. 4 shows the structured flowchart of the product information exhibiting device in a kind of video according to an embodiment of the invention;
Fig. 5 shows the structured flowchart of the product information exhibiting device in a kind of video according to an embodiment of the invention;
Fig. 6 shows the structured flowchart of the product information exhibiting device in a kind of video according to an embodiment of the invention;
Fig. 7 shows the structured flowchart of the product information display systems in a kind of video according to an embodiment of the invention;With And
Fig. 8 shows the structured flowchart of the product information presentation device in a kind of video according to an embodiment of the invention.
Specific embodiment
In order that those skilled in the art more fully understand the present invention program, below in conjunction with the embodiment of the present invention Accompanying drawing, is clearly and completely described to the technical scheme in the embodiment of the present invention.
In some flow processs of the description in description and claims of this specification and above-mentioned accompanying drawing, contain according to Multiple operations that particular order occurs, but it should be clearly understood that these operations can not be suitable according to its appearance herein Sequence, to execute or executed in parallel, sequence number such as 101,102 of operation etc., is only used for distinguishing each different operation, sequence number Itself do not represent any execution sequence.In addition, these flow processs can include more or less of operation, and these operations can To execute in order or executed in parallel.It should be noted that the description such as " first ", " second " herein, it is for distinguishing not Message together, equipment, module etc., do not represent sequencing, also not limiting " first " and " second " is different types.
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation description is it is clear that described embodiment is only a part of embodiment of the present invention, rather than whole embodiments.It is based on Embodiment in the present invention, the every other enforcement that those skilled in the art are obtained under the premise of not making creative work Example, broadly falls into the scope of protection of the invention.
Embodiment one
With reference to Fig. 1, it illustrates the FB(flow block) of the product information methods of exhibiting in a kind of video of the present invention, specifically can wrap Include:
Step 110, persistently receives first terminal and is playing the audio frequency play during video;
In embodiments of the present invention, video can be play in first terminal.For video, there is sound in its video data Frequency evidence, therefore first terminal are play and the audio-frequence player device of first terminal also can be used during video to play audio frequency.This audio frequency is broadcast Put speaker of equipment such as TV etc..
Wherein, first terminal can play the equipment of the sound of video and this video for TV, computer etc., this Bright embodiment is not any limitation as to it.Certainly, this first terminal can also be corresponding with video by device plays such as stereo sets Audio frequency.
If user wants to check the product information of the product in the video play in current first terminal, such as work as forward sight Occur in that a shoes in frequency, then user can open second terminal, persistently receive the audio frequency that first terminal is play, Ye Jijie Receive the sound wave that first terminal is sent by audio-frequence player devices such as speakers.
Wherein, second terminal can be the mobile terminal such as mobile phone, flat board.
In actual applications, the embodiment of the present invention can be pre-designed an application, and this application has step 110-120 Function, this application can be attached in its mobile terminal for user, then start this application when using, and enter step 110.
It is appreciated that for the audio frequency play in video playback, because playing process is continuous, the present invention is implemented The second terminal of example then can be carried out to this audio frequency point by the reception audio frequency of its apparatus for receiving audio such as mike persistence Analysis.
Preferably, in an alternative embodiment of the invention, before step 110, also include step 100-101:
Step 100, the audio frequency of video is divided into n section by playing the period;
Step 101, sets up corresponding between the product information in the video of each broadcasting period and the audio frequency of corresponding broadcasting period Relation.
In embodiments of the present invention, in advance various videos can be carried out with pretreatment, build the audio & video in video The corresponding relation of middle product information.The video of each collection of for example various TV play of this video, video of various films etc..
In actual applications, the embodiment of the present invention is directed to each video, and the audio frequency of video being pressed and plays Time segments division is n Section, such as presses every 3 seconds and divides one section.Period is play for each, the product information of the product in this video can be obtained, this product Product information can be a webpage, wherein can show the name of product of this product, product price, product brand, multiple products Picture, purchase interface etc..So linking of this audio frequency and this webpage can be carried out corresponding by the embodiment of the present invention, is built with audio frequency The vertical index to webpage.
Then step 110 can be entered, second terminal can be according to the product of the product in the audio retrieval video receiving Product information.
Certainly, in the embodiment of the present invention, the product information dependency with the product of video playback can also be more than threshold value The product information of product and this audio frequency carry out corresponding, when follow-up second terminal receives this audio frequency, can be by this product information It is also carried out showing.
Step 120, according to described audio frequency, based on default each play product information in the video of period and accordingly broadcast Put the corresponding relation between the audio frequency of period, obtain the corresponding product information of described sound from server and be shown.
In embodiments of the present invention, second terminal is after receiving audio frequency, due to presetting according to abovementioned steps 100-101 The corresponding relation between the product information in the video under audio frequency and this broadcasting period under each broadcasting period of each video, It is directed to each video, with the audio frequency in each reproduction time section of this video, the product information in the corresponding time period is constructed Index.So user is during viewing video, it is possible to use this audio frequency of second terminal real-time reception, and then second terminal is then To this real-time reception to audio frequency parse, be then based on default each play the period video in product information and phase The corresponding relation between the audio frequency of period should be play, obtain the corresponding product information of described sound from server and be shown.
Certainly, when showing product information it is provided that buying interface, user can be entered by clicking on this purchase interface Buy interface, then to electronic order under this product, then bought.
In the present invention one preferred embodiment, can be to the clothing needing to push play in the videos such as movie or television play Add ultrasound wave, above-mentioned clothes, jewelry, ornament etc. information in the respective audio segmentation of clothes, jewelry, ornament etc. information Can store in the server, the data base of described server includes item contents to be pushed in TV play, item contents phase Corresponding code, and the corresponding ultrasound data of code.First terminal by with corresponding to the currently playing video same period Article to be pushed sent out with the ultrasound wave being embedded in audio frequency, second terminal can be with real-time reception to ultrasonic accordingly Ripple, second terminal parses the corresponding code of corresponding ultrasound wave, and corresponding code is sent to server, is being counted by server Find the corresponding and corresponding Item Information of ultrasound wave according to the total search in storehouse, and this Item Information is sent to second terminal and show, should Item Information specifically includes the picture of article, price, buys link etc..This embodiment, using ultrasound wave, makes second terminal The shopping information of respective articles in video pictures can be received according to audio video synchronization, be a kind of advertisement reciever much sooner Method.When needing the purchase information of video, autonomous selection accepts client, has more selection modes.In the embodiment of the present invention In, for the ultrasound wave of each product, the application identification information of various applications can be added, and be beaten by this application in this application institute The product link opened.The above-mentioned various application such as shopping application such as Taobao's application, the application of Jingdone district store.So embodiment of the present invention Second terminal apply after parsing ultrasound wave in itself first, parse first from ultrasound wave application identification information and Corresponding product link, then searches corresponding application according to this application identification information, if it is found, then adjusting from mobile terminal Open corresponding product link with the corresponding application of this application identification information.If do not found, can be to server request The product information shown in one application, to be shown.
The embodiment of the present invention plays audio frequency during first terminal plays video, and second terminal is then broadcast in this video Receive during putting to should video audio frequency, then according to described audio frequency, based on default each play the period video In product information and the corresponding audio frequency playing the period between corresponding relation, obtain described sound corresponding product letter from server Breath is shown.In said process, the displaying of product information can be made coaxial with the broadcasting of video, user is in viewing video process In if it is desired to know certain part product information it is only necessary to viewing first terminal current presentation product information be can be known, no Go again to scan on network with user, simple to operate, quick.
Embodiment two
With reference to Fig. 2, it illustrates the FB(flow block) of the product information methods of exhibiting in a kind of video of the present invention, specifically can wrap Include:
Step 201, the audio frequency of video is divided into n section by playing the period.
In embodiments of the present invention, step 201-204 can execute in server side, and certainly, the present invention is not restricted to this.
In actual applications, various videos can be collected, such as cooperate with video owning side, owning side obtains from video Take various videos, such as the video of each collection of TV play, the video of film.
Step 202, sets up the core in each vocal print playing in the audio frequency in the period and the video accordingly playing the period Corresponding relation between product information.
So for each video, the embodiment of the present invention can by its according to reproduction time cutting be n section, such as every 3 seconds Divide once, or every five seconds for example divides once, then obtain the audio frequency concrete dividing mode embodiment of the present invention of n broadcasting period It is not any limitation as.
The audio frequency playing the period for each, can therefrom extract vocal print, go out in the video then obtaining this broadcasting period The product information of existing product, this product information is corresponding with this vocal print.It is of course possible to one is play the period and there are multiple products Information.Wherein, described vocal print (voiceprint) is it can be understood as carry the sound wave spectrum of verbal information.Implement in the present invention In example, it is to extract vocal print, voice of personage etc. in such as video for the audible common acoustic of the human ear in audio frequency.
It is appreciated that core product information and this vocal print pair of this broadcasting period then can be obtained in the embodiment of the present invention Should.Described core product information, can be the product showing one or several most frequent products in this broadcasting period video Information.
It should be noted that the page of the product information of each product in video in the embodiment of the present invention, can be built in advance Face.Because in a video, certain product possibly be present at the different broadcasting periods, so, for identical product, the present invention One product information can be only set.Then by the different audio frequency playing the periods vocal print to should product information.
Such as video a, the audio frequency of the broadcasting period of its 13-15 second is m1, and video a occurs in that product in the 12-15 second Product l1, l2, l3, wherein l1 are core product, then can generate product information for l1, l2, l3.Product by the vocal print of m1 and l1 Product information corresponds to.
So pass through said process, then the vocal print set up in the audio frequency in each broadcasting period plays regarding of period with corresponding The corresponding relation between core product information in frequency.
In actual applications, this corresponding relation can be stored in the data base of server.
Sum it up, the embodiment of the present invention is with audio frequency index building, in this index, the vocal print of audio frequency is keyword, product Information is as the object that is retrieved.
Wherein, step 202 can be the preferred step of step 101 in embodiment one.
Step 203, the audio frequency original position playing the period at each adds different ultrasound wave.
Ultrasound wave is the sound wave that human ear can not be heard, can adopt the speaker of first terminal in embodiments of the present invention In audiorange and the mike of second terminal can be with the ultrasound wave in identification range.Such as speaker support audiorange be 4khz-25khz(KHz), mike support identification 4khz-26khz(KHz), wherein 44khz-20khz is that human ear can be known Other audiorange, belongs to ultrasonic wave range more than 20khz, then the embodiment of the present invention can select 20khz -25khz scope Interior ultrasound wave adds in the original audio frequency of video.
In embodiments of the present invention, the starting position of the audio frequency that can play the period at each adds ultrasound wave.
The ultrasound wave that each plays the period is different from the ultrasound wave of other periods, namely the ultrasound wave of each period is unique 's.
Step 204, sets up the multiple product informations in each ultrasound wave playing the period and the video accordingly playing the period Between corresponding relation.
Period is play for each, obtains the product information of the various products occurring in the video of this broadcasting period, will be upper State product information and this ultrasound wave carry out corresponding, thus setting up ultrasound wave and corresponding video playing the period that each plays the period In multiple product informations between corresponding relation.
It is appreciated that the corresponding product information of ultrasound wave can include the multiple product informations in this broadcasting period, this is many Individual product information can include aforementioned core product information.
It is appreciated that in the embodiment of the present invention, can directly use the frequency spectrum of ultrasound wave corresponding with product information.Certainly, originally In inventive embodiments, ultrasound wave can be converted to feature coding, then this feature be encoded corresponding with product information.
Such as aforementioned audio m1, the p1 of the ultrasound wave of addition, then can be by the product of p1 and product l1, l2, l3 Information corresponds to.
So, the multiple product informations in each ultrasound wave playing the period and the video accordingly playing the period can be set up Between corresponding relation.
Step 205, persistently receives first terminal and is playing the audio frequency play during video.
In embodiments of the present invention, the audio frequency that with the addition of ultrasound wave can also be raised one's voice when playing video by first terminal using it Device is play, then the sound wave that speaker sends then includes the ultrasound wave that the sound wave of the original audio frequency of video and step 203 add.
Step 206, parses the ultrasound wave in described audio frequency;
The second terminal of the embodiment of the present invention then can parse ultrasound wave from the sound wave receiving, that is, from the sound persistently receiving Ultrasonic spectrum is isolated in frequency.
Such as, in previous example, for video a, in playing process, second terminal receive audio frequency, from 13 to 14 seconds it Between audio frequency in can parse ultrasound wave.
Preferably, in another preferred embodiment of the present invention, before step 206, also include step a11:
Step a11, virtual first mike and a second microphone;
In embodiments of the present invention, in order to the audio frequency receiving, start simultaneously at the extraction of the vocal print of common acoustic, and to super The identification of sound wave, all can obtain what it received with virtual two mikes, each mike at actual mike Audio frequency.
Preferably, on the basis of step a11, then step 206 includes sub-step a21-a22:
Sub-step a21, obtains audio frequency using the first mike from actual microphone;
Sub-step a22, parses ultrasound wave from described audio frequency;
The second terminal of so embodiment of the present invention, then can be obtained from the actual microphone of second terminal using the first mike Take the audio frequency of actual microphone typing.Then separate ultrasound wave from this audio frequency.
It is appreciated that the first mike could be arranged to filter common sound wave, frequency is more than the sound wave of the range of audibility.
Certainly, because audio frequency is persistence, the embodiment of the present invention then can obtain the frequency spectrum of ultrasound wave.
Step 207, according to described ultrasound wave, the ultrasound wave based on each broadcasting period default and corresponding broadcasting period The corresponding relation between multiple product informations in video, obtains the plurality of product information to be shown from server;
In embodiments of the present invention, after obtaining the frequency spectrum of ultrasound wave, then the frequency spectrum of this frequency spectrum and aforementioned preset can be entered Row coupling, if matched, according to the corresponding product information of this frequency spectrum, obtains each product information from server.
It is of course also possible to be identified according to pre-defined rule to the frequency spectrum of ultrasound wave, obtain aforesaid feature coding, then This feature coding being mated with the feature coding of aforementioned preset, if matched, being believed according to the corresponding product of this frequency spectrum Breath, obtains each product information from server.
Then, each product information can be shown in second terminal by second terminal.When there being multiple product information, Multiple product informations are shown in the same page.
In actual applications, second terminal can by parse the ultrasound wave that obtains with audio file in the way of, by mobile number Send to server according to modes such as network, wifi network, server is then mated with the ultrasound wave of aforementioned preset to ultrasound wave, When matching, then server obtains multiple product informations accordingly from data base, then can return the plurality of product information Return second terminal, second terminal multiple product informations that then the reception server returns are shown.Server can also be many by this Individual product information is synthesized to a page, is then shown this page return second terminal.Second so can be saved eventually The computing resource at end.
Certainly, second terminal can also send the frequency spectrum of ultrasound wave to server, by server, frequency spectrum is parsed And matching process, find product information and return second terminal, the embodiment of the present invention is not any limitation as to it.
Step 208, using the audio frequency of specified time span longer than the corresponding audio frequency of ultrasound wave, parses vocal print;
In actual applications, because the frequency of ultrasound wave is high, so it can be identified using the ultrasound wave in the short period, Ultrasound wave can correctly be identified within such as 1 second.And it may be necessary to the frequency spectrum of longer sound could just for common acoustic Really identify, the common acoustic of such as 3 seconds.
Therefore after aforementioned ultrasonic identification completes to have illustrated multiple product informations, common acoustic is also unidentified complete Become, then the sound that the present invention can obtain the audio frequency and designated length afterwards separating ultrasound wave goes to parse vocal print.
Such as, in previous example, for video a, second terminal constantly receives audio frequency, then can be from the audio frequency of 13-15 second In isolate common acoustic, then identify the corresponding vocal print of this common acoustic.
Certainly, if unidentified go out vocal print, can be identified continuing with the audio frequency of follow-up designated length.
Preferably, on the basis of abovementioned steps a11, then step 208, including sub-step a31-a32:
Sub-step a31, obtains audio frequency using second microphone from actual microphone;
Sub-step a32, parses vocal print from described audio frequency.
In actual applications, second microphone can obtain audio frequency from actual microphone, and second microphone is permissible Filter ultrasound wave, retain the common sound wave in the human ear range of audibility.
Then second microphone then can parse vocal print from this common acoustic.
Step 209, according to described vocal print, is play with corresponding based on each vocal print play in the audio frequency in the period default The corresponding relation between core product information in the video of period, obtains described core product information to replace from server State multiple product informations to be shown.
In actual applications, second terminal can send the common acoustic isolated from audio frequency to scope, by servicing Device goes to parse vocal print.Certainly, second terminal can identify vocal print, then sends vocal print to server.By server by this sound Stricture of vagina is mated with the vocal print that aforementioned preset obtains, if matched, server obtains this vocal print corresponding core product letter Then core product information returned second terminal by breath.
Multiple product informations that second terminal is shown before then replacing it core product information, are entered with more precision products information Row is shown.
It is appreciated that constantly identifying new product information in the embodiment of the present invention, then can be by new product information Product information before replacing it is shown.
In actual applications, because first terminal video is persistently to play, audio frequency is also persistently to play, then second terminal The displaying of product information be continually changing also with playing process.User checks the product information shown before for convenience, this The product information that inventive embodiments can be shown with log history, according to time shafts record, and can provide and check and connect in record Mouthful, facilitate user to check.
In addition, in actual applications, server can also obtain the preference of the user of second terminal, according to its preference from this Play and in the multiple product informations in the period, select a product information more mated with preference, return as core product information It is shown to second terminal.
Wherein, step 206- step 209 is the preferred step of embodiment one step 120.
Preferably, after step 209, also include:
Step 210, the corresponding relation between the product information according to feedback and reproduction time, modification vocal print plays the period with corresponding Video in core product information between corresponding relation.
In actual applications, user may less meet its demand to playing the product information sensation shown in the period, can To submit product information and its reproduction time of the product that it more takes notice of to by feedback interface provided in an embodiment of the present invention.
So the embodiment of the present invention then can count the feedback of each user, then reproduction time was located in the time period, The proportion that the feedback number of certain product information accounts for from feedback number exceedes certain threshold value, and such as 70%, then by this product information As the core product information of this broadcasting period, then replace this audio frequency corresponding core product information originally.
Such as aforementioned audio is m1, and video a occurs in that product l1, l2, l3 in the 12-15 second, and wherein l1 is core product, The vocal print of m1 is corresponding with the product information of l1.Based on above-mentioned feedback, l2 is the product of user's more concern, then can make l2 For core product, then that the vocal print of m1 is corresponding with the product information of l2.
Preferably, after step 209, also include:
Step 211, receive user shows the purchase request of triggering in interface in product information, and asks to generate according to described purchase Purchase order.
In embodiments of the present invention, user buys for convenience, can also show interface in the product information of second terminal In for each product information provide corresponding buy button, user can click on this purchase button, and request is bought in triggering.Then may be used To send this purchase request to server, server then buys request generation purchase order according to described, thinks that this user carries For actual product.
The scheme that the present invention provides, plays audio frequency during first terminal plays video, and second terminal is then at this Receive during video playback to should video audio frequency, then according to described audio frequency, based on default each play period Video in product information and the corresponding audio frequency playing the period between corresponding relation, obtain described sound from server corresponding Product information is shown.In said process, can make that the displaying of product information is coaxial with the broadcasting of video, user regards in viewing If it is desired to know the information of certain part product it is only necessary to watch the product information of first terminal current presentation during frequency Know, go again to scan on network without user, simple to operate, quick.
Secondly, for ultrasound wave and the corresponding common acoustic of this ultrasound wave, due to the audio frequency capacity in order to reduce video, only Start to the addition of fraction ultrasound wave in audio parsing, rather than with the addition of ultrasound wave in whole periods, therefore, ultrasound wave corresponds to Broadcasting the period video in occur product more, ultrasound wave show product information more.And the core of common acoustic is produced Product information and video pictures more agree with, then the product information that common acoustic is shown is more accurate.
Again, because the resolution speed of ultrasound wave is fast, and the resolution speed of common acoustic is slow, so identifying ultrasound wave Afterwards, product information can quickly be shown, user will not compensate for identification commonly because of showing that postponing excessively thinks software corruption The relatively long idle time of the vocal print of sound.
Embodiment three
With reference to Fig. 3, it illustrates the FB(flow block) of the product information methods of exhibiting in a kind of video of the present invention, specifically can wrap Include:
Step 301, the audio frequency of video is divided into n section by playing the period.
Step 302, sets up the core in each vocal print playing in the audio frequency in the period and the video accordingly playing the period Corresponding relation between product information.
Step 303, the audio frequency original position playing the period at each adds different ultrasound wave.
Step 304, sets up the multiple product informations in each ultrasound wave playing the period and the video accordingly playing the period Between corresponding relation.
Step 305, persistently receives first terminal and is playing the audio frequency play during video.
Step 306, parses the ultrasound wave in described audio frequency;
Step 307, according to described ultrasound wave, the ultrasound wave based on each broadcasting period default and the corresponding video playing the period In multiple product informations between corresponding relation, from server obtain the plurality of product information to be shown;
Step 308, searches the uniquely affiliated video of this ultrasound wave according to described ultrasound wave;
Step 309, using the audio frequency of specified time span longer than the corresponding audio frequency of ultrasound wave, parses vocal print.
Step 310, described vocal print is mated with each vocal print in the whole audiorange of described video;If Mix, then enter step 311;
In embodiments of the present invention, can be with the segmentation of the audio frequency of certain multiple video, its vocal print is identical, then the embodiment of the present invention The vocal print of this kind of situation can be directed to, be video tab belonging to each vocal print adds, also add video tab for ultrasound wave simultaneously.Logical Cross after ultrasound wave determines video tab, then to audio frequency parsing vocal print after, then according to the sound under video tab and this video tab Stricture of vagina is mated, and then can enter step 311.
Step 311, according to described vocal print, is play with corresponding based on each vocal print play in the audio frequency in the period default The corresponding relation between core product information in the video of period, obtains described core product information to replace from server State multiple product informations to be shown.
The scheme that the present invention provides, plays audio frequency during first terminal plays video, and second terminal is then at this Receive during video playback to should video audio frequency, then according to described audio frequency, based on default each play period Video in product information and the corresponding audio frequency playing the period between corresponding relation, obtain described sound from server corresponding Product information is shown.In said process, can make that the displaying of product information is coaxial with the broadcasting of video, user regards in viewing If it is desired to know the information of certain part product it is only necessary to watch the product information of first terminal current presentation during frequency Know, go again to scan on network without user, simple to operate, quick.
Secondly, for ultrasound wave and the corresponding common acoustic of this ultrasound wave, due to the audio frequency capacity in order to reduce video, only Start to the addition of fraction ultrasound wave in audio parsing, rather than with the addition of ultrasound wave in whole periods, therefore, ultrasound wave corresponds to Broadcasting the period video in occur product more, ultrasound wave show product information more.And the core of common acoustic is produced Product information and video pictures more agree with, then the product information that common acoustic is shown is more accurate.
Again, because the resolution speed of ultrasound wave is fast, and the resolution speed of common acoustic is slow, so identifying ultrasound wave Afterwards, product information can quickly be shown, user will not compensate for identification commonly because of showing that postponing excessively thinks software corruption The relatively long idle time of the vocal print of sound.
Finally, which video can be belonged to by ultrasonic locating audio frequency, regard thus avoiding a vocal print and belonging to multiple During frequency, product information may show the situation of mistake, and the product information of such as video a is shown when video b plays.
For embodiment of the method, in order to be briefly described, therefore it is all expressed as a series of combination of actions, but this area Technical staff should know, the embodiment of the present invention is not limited by described sequence of movement, because implementing according to the present invention Example, some steps can be carried out using other orders or simultaneously.Secondly, those skilled in the art also should know, description Described in embodiment belong to preferred embodiment, necessary to the involved action not necessarily embodiment of the present invention.
Example IV
With reference to Fig. 4, show the structural frames of the product information exhibiting device in a kind of video according to an embodiment of the invention Figure, specifically may include that
Audio frequency receiver module 410, is playing, for persistently receiving first terminal, the audio frequency play during video;
Synchronous display module 420, for according to described audio frequency, the product information in video based on each broadcasting period default The corresponding relation and audio frequency of corresponding broadcasting period between, obtains the corresponding product information of described sound from server and is shown.
Preferably, also include:
Video division module, for being divided into n section by the audio frequency of video by playing the period;
First relation sets up module, for setting up product information and the corresponding sound playing the period in the video that each plays the period Corresponding relation between frequency.
The scheme that the present invention provides, plays audio frequency during first terminal plays video, and second terminal is then at this Receive during video playback to should video audio frequency, then according to described audio frequency, based on default each play period Video in product information and the corresponding audio frequency playing the period between corresponding relation, obtain described sound from server corresponding Product information is shown.In said process, can make that the displaying of product information is coaxial with the broadcasting of video, user regards in viewing If it is desired to know the information of certain part product it is only necessary to watch the product information of first terminal current presentation during frequency Know, go again to scan on network without user, simple to operate, quick.
Embodiment five
With reference to Fig. 5, show the structural frames of the product information exhibiting device in a kind of video according to an embodiment of the invention Figure, specifically may include that
Video division module 510, for being divided into n section by the audio frequency of video by playing the period;
First relation sets up module 511, plays the period for setting up the product information in the video that each plays the period with corresponding Audio frequency between corresponding relation, specifically include:
First relation setting up submodule 5111, plays the period for setting up each vocal print play in the audio frequency in the period with corresponding Video in core product information between corresponding relation;
Ultrasound wave add module 512, the audio frequency original position for playing the period at each adds different ultrasound wave;
Second relation sets up module 513, for setting up in each ultrasound wave playing the period and the video accordingly playing the period Corresponding relation between multiple product informations.
Audio frequency receiver module 520, is playing, for persistently receiving first terminal, the audio frequency play during video;
Synchronous display module 530, for according to described audio frequency, the product information in video based on each broadcasting period default The corresponding relation and audio frequency of corresponding broadcasting period between, obtains the corresponding product information of described sound from server and is shown, Specifically include:
Ultrasound wave analyzing sub-module 531, for parsing the ultrasound wave in described audio frequency;
Ultrasound wave shows submodule 532, for according to described ultrasound wave, the ultrasound wave based on each broadcasting period default and phase The corresponding relation between the multiple product informations in the video of period should be play, from server obtain the plurality of product information with It is shown;
Common acoustic analyzing sub-module 533, for the audio frequency using specified time span longer than the corresponding audio frequency of ultrasound wave, parsing Vocal print;
Common acoustic shows submodule 534, according to described vocal print, based on the vocal print in the audio frequency in each broadcasting period default Corresponding relation and the core product information in the video of corresponding broadcasting period between, obtains described core product letter from server Breath is shown with replacing the plurality of product information.
Preferably, in synchronous display module 530, before described common acoustic analyzing sub-module 533, also include:
Video determination sub-module, for searching the uniquely affiliated video of this ultrasound wave according to described ultrasound wave.
Further, then after common acoustic analyzing sub-module 533, comprising:
Vocal print searches submodule, for carrying out described vocal print and each vocal print in the whole audiorange of described video Join;If matching, entering common acoustic and showing submodule 534.
Preferably, before ultrasound wave analyzing sub-module 531, also include:
Mike virtual module, for virtual first mike and a second microphone.
Further, then ultrasound wave analyzing sub-module 531 includes:
First acquisition submodule, for obtaining audio frequency using the first mike from actual microphone;
First analyzing sub-module, for parsing ultrasound wave from described audio frequency;
Further, then common acoustic analyzing sub-module 533 includes:
Second acquisition submodule, for obtaining audio frequency using second microphone from actual microphone;
Second analyzing sub-module, for parsing vocal print from described audio frequency.
Preferably, after described synchronous display module 530, also include:
Relation modified module, for the corresponding relation between the product information according to feedback and reproduction time, modification vocal print and phase The corresponding relation between the core product information in the video of period should be play.
Preferably, after described synchronous display module 530, also include:
Buy module, show the purchase request of triggering in interface for receive user in product information, and please according to described purchase Seek survival into purchase order.
The scheme that the present invention provides, plays audio frequency during first terminal plays video, and second terminal is then at this Receive during video playback to should video audio frequency, then according to described audio frequency, based on default each play period Video in product information and the corresponding audio frequency playing the period between corresponding relation, obtain described sound from server corresponding Product information is shown.In said process, can make that the displaying of product information is coaxial with the broadcasting of video, user regards in viewing If it is desired to know the information of certain part product it is only necessary to watch the product information of first terminal current presentation during frequency Know, go again to scan on network without user, simple to operate, quick.
Secondly, for ultrasound wave and the corresponding common acoustic of this ultrasound wave, due to the audio frequency capacity in order to reduce video, only Start to the addition of fraction ultrasound wave in audio parsing, rather than with the addition of ultrasound wave in whole periods, therefore, ultrasound wave corresponds to Broadcasting the period video in occur product more, ultrasound wave show product information more.And the core of common acoustic is produced Product information and video pictures more agree with, then the product information that common acoustic is shown is more accurate.
Again, because the resolution speed of ultrasound wave is fast, and the resolution speed of common acoustic is slow, so identifying ultrasound wave Afterwards, product information can quickly be shown, user will not compensate for identification commonly because of showing that postponing excessively thinks software corruption The relatively long idle time of the vocal print of sound.
Embodiment six
With reference to Fig. 6, show the structural frames of the product information exhibiting device in a kind of video according to an embodiment of the invention Figure, specifically may include that
Video division module 610, for being divided into n section by the audio frequency of video by playing the period;
First relation sets up module 611, plays the period for setting up the product information in the video that each plays the period with corresponding Audio frequency between corresponding relation, specifically include:
First relation setting up submodule 6111, plays the period for setting up each vocal print play in the audio frequency in the period with corresponding Video in core product information between corresponding relation;
Ultrasound wave add module 612, the audio frequency original position for playing the period at each adds different ultrasound wave;
Second relation sets up module 613, for setting up in each ultrasound wave playing the period and the video accordingly playing the period Corresponding relation between multiple product informations.
Audio frequency receiver module 620, is playing, for persistently receiving first terminal, the audio frequency play during video;
Synchronous display module 630, for according to described audio frequency, the product information in video based on each broadcasting period default The corresponding relation and audio frequency of corresponding broadcasting period between, obtains the corresponding product information of described sound from server and is shown, Specifically include:
Ultrasound wave analyzing sub-module 631, for parsing the ultrasound wave in described audio frequency;
Ultrasound wave shows submodule 632, for according to described ultrasound wave, the ultrasound wave based on each broadcasting period default and phase The corresponding relation between the multiple product informations in the video of period should be play, from server obtain the plurality of product information with It is shown;
Video determination sub-module 633, for searching the uniquely affiliated video of this ultrasound wave according to described ultrasound wave.
Common acoustic analyzing sub-module 634, for the audio frequency using specified time span longer than the corresponding audio frequency of ultrasound wave, Parsing vocal print;
Vocal print searches submodule 635, for carrying out described vocal print with each vocal print in the whole audiorange of described video Coupling;If matching, entering common acoustic and showing submodule 636.
Common acoustic shows submodule 636, according to described vocal print, based in the audio frequency in each broadcasting period default The corresponding relation between core product information in the video of vocal print and corresponding broadcasting period, obtains described core from server and produces Product information is shown with replacing the plurality of product information.
The scheme that the present invention provides, plays audio frequency during first terminal plays video, and second terminal is then at this Receive during video playback to should video audio frequency, then according to described audio frequency, based on default each play period Video in product information and the corresponding audio frequency playing the period between corresponding relation, obtain described sound from server corresponding Product information is shown.In said process, can make that the displaying of product information is coaxial with the broadcasting of video, user regards in viewing If it is desired to know the information of certain part product it is only necessary to watch the product information of first terminal current presentation during frequency Know, go again to scan on network without user, simple to operate, quick.
Secondly, for ultrasound wave and the corresponding common acoustic of this ultrasound wave, due to the audio frequency capacity in order to reduce video, only Start to the addition of fraction ultrasound wave in audio parsing, rather than with the addition of ultrasound wave in whole periods, therefore, ultrasound wave corresponds to Broadcasting the period video in occur product more, ultrasound wave show product information more.And the core of common acoustic is produced Product information and video pictures more agree with, then the product information that common acoustic is shown is more accurate.
Again, because the resolution speed of ultrasound wave is fast, and the resolution speed of common acoustic is slow, so identifying ultrasound wave Afterwards, product information can quickly be shown, user will not compensate for identification commonly because of showing that postponing excessively thinks software corruption The relatively long idle time of the vocal print of sound.
Finally, which video can be belonged to by ultrasonic locating audio frequency, regard thus avoiding a vocal print and belonging to multiple During frequency, product information may show the situation of mistake, and the product information of such as video a is shown when video b plays.
Embodiment seven
With reference to Fig. 7, show the structural frames of the product information display systems in a kind of video according to an embodiment of the invention Figure, specifically may include that
First terminal 710, second terminal 720, server 730;
Described second terminal 720 includes:
Audio frequency receiver module 721, is playing, for persistently receiving first terminal, the audio frequency play during video;
Synchronous display module 722, for according to described audio frequency, the product information in video based on each broadcasting period default The corresponding relation and audio frequency of corresponding broadcasting period between, obtains the corresponding product information of described sound from server and is shown;
Described first terminal 710 is used for playing described video and the audio frequency of described video;
Described server 730 is used for providing described product information.
In embodiments of the present invention, can also include in server side:
Video division module, for being divided into n section by the audio frequency of video by playing the period;
First relation sets up module, for setting up product information and the corresponding sound playing the period in the video that each plays the period Corresponding relation between frequency.
Preferably, described first relation sets up module, specifically includes:
First relation setting up submodule, plays regarding of period for setting up each vocal print play in the audio frequency in the period with corresponding The corresponding relation between core product information in frequency;
Further, also include in server side:
Sound wave add module, the audio frequency original position for playing the period at each adds different ultrasound wave;
Second relation sets up module, multiple in each ultrasound wave playing the period and the video accordingly playing the period for setting up Corresponding relation between product information.
Preferably, also include in server side:
Relation modified module, for the corresponding relation between the product information according to feedback and reproduction time, modification vocal print and phase The corresponding relation between the core product information in the video of period should be play.
Preferably, in second terminal side, described synchronous display module specifically includes:
Ultrasound wave analyzing sub-module, for parsing the ultrasound wave in described audio frequency;
Ultrasound wave shows submodule, for according to described ultrasound wave, based on default each play the ultrasound wave of period with corresponding Play the corresponding relation between the multiple product informations in the video of period, obtain the plurality of product information to enter from server Row is shown;
Certainly, in practical application, ultrasound wave shows that submodule includes the first sending submodule and the first receiving submodule, first Submodule is sent to be used for sending described ultrasound wave to server by network, by server according to described ultrasound wave, based on default Each plays the corresponding relation between the multiple product informations in the ultrasound wave and the video of corresponding broadcasting period of period, obtains institute State multiple product informations and return;First receiving submodule is used for multiple product informations of the reception server return to be opened up Show.
Common acoustic analyzing sub-module, for the audio frequency using specified time span longer than the corresponding audio frequency of ultrasound wave, solution Analysis vocal print;
Common acoustic shows submodule, according to described vocal print, based on default each play vocal print in the audio frequency in period with The corresponding relation between core product information in the video of corresponding broadcasting period, obtains described core product information from server It is shown with replacing the plurality of product information.
Certainly, in practical application, common acoustic shows that submodule includes the second sending submodule and the second receiving submodule, Second sending submodule is used for sending described vocal print to server by network, by server according to described vocal print, based on default Each play corresponding between the core product information in vocal print in the audio frequency in period and the corresponding video playing the period Relation, obtains core product information and returns;Second receiving submodule be used for the reception server return core product information with Replace the plurality of product information to be shown.
Preferably, in second terminal side, synchronous display module, in, before described common acoustic analyzing sub-module, also wrap Include:
Video determination sub-module, for searching the uniquely affiliated video of this ultrasound wave according to described ultrasound wave.
Further, then common acoustic analyzing sub-module, comprising:
Vocal print searches submodule, for carrying out described vocal print and each vocal print in the whole audiorange of described video Join;If matching, entering common acoustic and showing submodule.
Preferably, before ultrasound wave analyzing sub-module, also include:
Mike virtual module, for virtual first mike and a second microphone.
Further, in second terminal side, described ultrasound wave analyzing sub-module includes:
First acquisition submodule, for obtaining audio frequency using the first mike from actual microphone;
First analyzing sub-module, for parsing ultrasound wave from described audio frequency;
Further, then common acoustic analyzing sub-module includes:
Second acquisition submodule, for obtaining audio frequency using second microphone from actual microphone;
Second analyzing sub-module, for parsing vocal print from described audio frequency.
Preferably, in second terminal side, after described synchronous display module, also include:
Buy module, show the purchase request of triggering in interface for receive user in product information, and buy request according to stating Generate purchase order.
The scheme that the present invention provides, plays audio frequency during first terminal plays video, and second terminal is then at this Receive during video playback to should video audio frequency, then according to described audio frequency, based on default each play period Video in product information and the corresponding audio frequency playing the period between corresponding relation, obtain described sound from server corresponding Product information is shown.In said process, can make that the displaying of product information is coaxial with the broadcasting of video, user regards in viewing If it is desired to know the information of certain part product it is only necessary to watch the product information of first terminal current presentation during frequency Know, go again to scan on network without user, simple to operate, quick.
Embodiment eight
The embodiment of the present invention additionally provides the product information exhibition equipment in a kind of video, as shown in figure 8, for convenience of description, only Show the part related to the embodiment of the present invention, particular technique details does not disclose, and refer to present invention method portion Point.This terminal can be including mobile phone, panel computer, pda(personal digital assistant, and individual digital helps Reason), pos(point of sales, point-of-sale terminal), the arbitrarily terminal unit such as vehicle-mounted computer, so that terminal is as mobile phone as a example:
Fig. 8 is illustrated that the block diagram of the part-structure of the mobile phone related to terminal provided in an embodiment of the present invention.With reference to Fig. 8, handss Machine includes: radio frequency (radio frequency, rf) circuit 810, memorizer 820, input block 830, display unit 840, sensing Device 850, voicefrequency circuit 860, Wireless Fidelity (wireless fidelity, wifi) module 870, processor 880 and power supply 890 grade parts.It will be understood by those skilled in the art that the handset structure shown in Fig. 8 does not constitute the restriction to mobile phone, permissible Illustrate more or less of part including ratio, or combine some parts, or different part arrangements.
With reference to Fig. 8, each component parts of mobile phone are specifically introduced:
Rf circuit 810 can be used for receiving and sending messages or communication process in, the reception of signal and transmission, especially, base station is descending After information receives, process to processor 880;In addition, up data is activation will be designed to base station.Generally, rf circuit 810 includes But be not limited to antenna, at least one amplifier, transceiver, bonder, low-noise amplifier (low noise amplifier, Lna), duplexer etc..Additionally, rf circuit 810 can also be communicated with network and other equipment by radio communication.Above-mentioned channel radio Letter can use arbitrary communication standard or agreement, including but not limited to global system for mobile communications (global system of Mobile communication, gsm), general packet radio service (general packet radio service, Gprs), CDMA (code division multiple access, cdma), WCDMA (wideband code Division multiple access, wcdma), Long Term Evolution (long term evolution, lte), Email, Short Message Service (short messaging service, sms) etc..
Memorizer 820 can be used for storing software program and module, and processor 880 is stored in memorizer 820 by operation Software program and module, thus executing various function application and the data processing of mobile phone.Memorizer 820 can mainly include Storing program area and storage data field, wherein, storing program area can application journey needed for storage program area, at least one function Sequence (such as sound-playing function, image player function etc.) etc.;Storage data field can store according to mobile phone using being created Data (such as voice data, phone directory etc.) etc..Additionally, memorizer 820 can include high-speed random access memory, acceptable Including nonvolatile memory, for example, at least one disk memory, flush memory device or other volatile solid-state Part.
Input block 830 can be used for numeral or the character information of receives input, and produce with the user setup of mobile phone with And the key signals input that function control is relevant.Specifically, input block 830 may include contact panel 831 and other inputs set Standby 832.Contact panel 831, also referred to as touch screen, can collect user thereon or neighbouring touch operation (such as user uses Any suitable object such as finger, stylus or adnexa on contact panel 831 or the operation near contact panel 831), and root Drive corresponding attachment means according to formula set in advance.Optionally, contact panel 831 may include touch detecting apparatus and touch Two parts of controller.Wherein, touch detecting apparatus detect the touch orientation of user, and detect the signal that touch operation brings, Transmit a signal to touch controller;Touch controller receives touch information from touch detecting apparatus, and is converted into touching Point coordinates, then give processor 880, and can the order sent of receiving processor 880 being executed.Furthermore, it is possible to using electricity The polytypes such as resistive, condenser type, infrared ray and surface acoustic wave realize contact panel 831.Except contact panel 831, input Unit 830 can also include other input equipments 832.Specifically, other input equipments 832 can include but is not limited to secondary or physical bond One or more of disk, function key (such as volume control button, switch key etc.), trace ball, mouse, action bars etc..
Display unit 840 can be used for display and by the information of user input or is supplied to the information of user and the various of mobile phone Menu.Display unit 840 may include display floater 841, optionally, can adopt liquid crystal display (liquid crystal Display, lcd), the form such as Organic Light Emitting Diode (organic light-emitting diode, oled) aobvious to configure Show panel 841.Further, contact panel 831 can cover display floater 841, when contact panel 831 detect thereon or attached After near touch operation, send processor 880 to determine the type of touch event, with preprocessor 880 according to touch event Type corresponding visual output is provided on display floater 841.Although in fig. 8, contact panel 831 and display floater 841 It is input and the input function to realize mobile phone as two independent parts, but in some embodiments it is possible to by touch-control Panel 831 is integrated with display floater 841 and realizes mobile phone input and output function.
Mobile phone may also include at least one sensor 850, such as optical sensor, motion sensor and other sensors. Specifically, optical sensor may include ambient light sensor and proximity transducer, and wherein, ambient light sensor can be according to ambient light The brightness to adjust display floater 841 for the light and shade, proximity transducer can cut out display floater 841 when mobile phone moves in one's ear And/or backlight.As one kind of motion sensor, accelerometer sensor can detect (generally three axles) acceleration in all directions Size, can detect that size and the direction of gravity when static, can be used for identify mobile phone attitude application (such as horizontal/vertical screen is cut Change, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap) etc.;Also may be used as mobile phone The other sensors such as the gyroscope of configuration, barometer, drimeter, thermometer, infrared ray sensor, will not be described here.
Voicefrequency circuit 860, speaker 861, microphone 862 can provide the audio interface between user and mobile phone.Audio-frequency electric The signal of telecommunication after the voice data receiving conversion can be transferred to speaker 861, is converted to sound by speaker 861 by road 860 Signal output;On the other hand, the acoustical signal of collection is converted to the signal of telecommunication by microphone 862, turns after being received by voicefrequency circuit 860 It is changed to voice data, then after voice data output processor 880 is processed, through rf circuit 810 to be sent to such as another mobile phone, Or voice data is exported to memorizer 820 to process further.
Wifi belongs to short range wireless transmission technology, and mobile phone can help user's transceiver electronicses postal by wifi module 870 Part, browse webpage and access streaming video etc., it has provided the user wireless broadband internet and has accessed.Although Fig. 8 shows Wifi module 870, but it is understood that, it is simultaneously not belonging to must be configured into of mobile phone, can not change as needed completely Omit in the scope of the essence becoming invention.
Processor 880 is the control centre of mobile phone, using the various pieces of various interfaces and connection whole mobile phone, leads to Cross and run or software program and/or module that execution is stored in memorizer 820, and call and be stored in memorizer 820 Data, the various functions of execution mobile phone and processing data, thus carry out integral monitoring to mobile phone.Optionally, processor 880 can wrap Include one or more processing units;Preferably, processor 880 can integrated application processor and modem processor, wherein, should Mainly process operating system, user interface and application program etc. with processor, modem processor mainly processes radio communication. It is understood that above-mentioned modem processor can not also be integrated in processor 880.
Mobile phone also includes the power supply 890(such as battery powered to all parts) it is preferred that power supply can pass through power supply pipe Reason system is logically contiguous with processor 880, thus realizing management charging, electric discharge and power managed by power-supply management system Etc. function.
Although not shown, mobile phone can also include photographic head, bluetooth module etc., will not be described here.
In embodiments of the present invention, the processor 880 included by this terminal also has following functions:
Persistently receive first terminal and play the audio frequency play during video;
According to described audio frequency, the product information in video based on each broadcasting period default and the corresponding audio frequency playing the period Between corresponding relation, from server obtain the corresponding product information of described sound be shown.
Certainly, for corresponding between the audio frequency of the product information in the video of each broadcasting period and corresponding broadcasting period The foundation of relation can be carried out in server side.
Those skilled in the art can be understood that, for convenience and simplicity of description, the system of foregoing description, Device and the specific work process of unit, may be referred to the corresponding process in preceding method embodiment, will not be described here.
It should be understood that disclosed system in several embodiments provided herein, apparatus and method are permissible Realize by another way.For example, device embodiment described above is only schematically, for example, described unit Divide, only a kind of division of logic function, actual can have other dividing mode when realizing, for example multiple units or assembly Can in conjunction with or be desirably integrated into another system, or some features can be ignored, or does not execute.Another, shown or The coupling each other discussing or direct-coupling or communication connection can be by some interfaces, the indirect coupling of device or unit Close or communicate to connect, can be electrical, mechanical or other forms.
The described unit illustrating as separating component can be or may not be physically separate, show as unit The part showing can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple On NE.The mesh to realize this embodiment scheme for some or all of unit therein can be selected according to the actual needs 's.
In addition, can be integrated in a processing unit in each functional unit in each embodiment of the present invention it is also possible to It is that unit is individually physically present it is also possible to two or more units are integrated in a unit.Above-mentioned integrated list Unit both can be to be realized in the form of hardware, it would however also be possible to employ the form of SFU software functional unit is realized.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment is can Completed with the hardware instructing correlation by program, this program can be stored in a computer-readable recording medium, storage Medium may include that read only memory (rom, read only memory), random access memory (ram, random Access memory), disk or CD etc..
One of ordinary skill in the art will appreciate that it is permissible for realizing all or part of step in above-described embodiment method The hardware being instructed correlation by program is completed, and described program can be stored in a kind of computer-readable recording medium, on Stating the storage medium mentioned can be read only memory, disk or CD etc..
Above the product information presentation device in a kind of video provided by the present invention is described in detail, for this The those skilled in the art in field, according to the thought of the embodiment of the present invention, all have in specific embodiments and applications and change In place of change, in sum, this specification content should not be construed as limitation of the present invention.

Claims (10)

1. the product information methods of exhibiting in a kind of video is it is characterised in that include:
Persistently receive first terminal and play the audio frequency play during video;
According to described audio frequency, the product information in video based on each broadcasting period default and the corresponding audio frequency playing the period Between corresponding relation, from server obtain the corresponding product information of described sound be shown.
2. method according to claim 1 is it is characterised in that also include:
The audio frequency of video is divided into n section by playing the period;
Set up the corresponding relation between the product information in the video of each broadcasting period and the audio frequency of corresponding broadcasting period.
3. method according to claim 2 it is characterised in that described set up each play the period video in product letter The step of the corresponding relation between the audio frequency of breath and corresponding broadcasting period, comprising:
Set up between the core product information in the vocal print and the video of corresponding broadcasting period in the audio frequency in each broadcasting period Corresponding relation;
Further, also include:
The audio frequency original position playing the period at each adds different ultrasound wave;
Set up the corresponding pass between the multiple product informations in ultrasound wave and the video of corresponding broadcasting period of each broadcasting period System.
4. method according to claim 3 it is characterised in that described according to described audio frequency, based on each broadcasting default Corresponding relation between product information in the video of period and the audio frequency of corresponding broadcasting period, obtains described sound pair from server The step that the product information answered is shown, comprising:
Parse the ultrasound wave in described audio frequency;
According to described ultrasound wave, based on default each play multiple in the ultrasound wave of period and the video of corresponding broadcasting period Corresponding relation between product information, obtains the plurality of product information to be shown from server;
Using the audio frequency of specified time span longer than the corresponding audio frequency of ultrasound wave, parse vocal print;
According to described vocal print, based in the vocal print and the video of corresponding broadcasting period in the audio frequency in each broadcasting period default Core product information between corresponding relation, obtain described core product information to replace the plurality of product letter from server Breath is shown.
5. method according to claim 4 is it is characterised in that described utilize than the corresponding audio frequency of ultrasound wave the long specified time The audio frequency of length, before the step of parsing vocal print, also includes:
The uniquely affiliated video of this ultrasound wave is searched according to described ultrasound wave;
Further, then the described audio frequency using specified time span longer than the corresponding audio frequency of ultrasound wave, the step of parsing vocal print Afterwards, also include:
Described vocal print is mated with each vocal print in the whole audiorange of described video;
If matched, enter according to described vocal print, based on the vocal print in the audio frequency in each broadcasting period default and phase The corresponding relation between the core product information in the video of period should be play, from server obtain described core product information with Replace the step that the plurality of product information is shown.
6. method according to claim 4 it is characterised in that parse described audio frequency in ultrasound wave step before, Also include:
Virtual first mike and a second microphone;
Further, then the step parsing the ultrasound wave in described audio frequency includes:
Obtain audio frequency using the first mike from actual microphone;
Ultrasound wave is parsed from described audio frequency;
Further, then the audio frequency of specified time span longer than the corresponding audio frequency of ultrasound wave, the step of parsing vocal print, bag are utilized Include:
Obtain audio frequency using second microphone from actual microphone;
Vocal print is parsed from described audio frequency.
7. according to method described in one of them for claim 3-6 it is characterised in that according to described audio frequency, based on default Each plays the corresponding relation between the product information in the video of period and the audio frequency of corresponding broadcasting period, obtains from server After the step that the corresponding product information of described sound is shown, also include:
Corresponding relation between product information according to feedback and reproduction time, in the video of modification vocal print and corresponding broadcasting period Core product information between corresponding relation.
8. method according to claim 1 is it is characterised in that according to described audio frequency, based on during each broadcasting default Corresponding relation between product information in the video of section and the audio frequency of corresponding broadcasting period, obtains described sound from server and corresponds to The step that is shown of product information after, also include:
The purchase request of receive user triggering in product information displaying interface, and ask generation purchase to be ordered according to described purchase Single.
9. the product information exhibiting device in a kind of video is it is characterised in that include:
Audio frequency receiver module, is playing, for persistently receiving first terminal, the audio frequency play during video;
Synchronous display module, for according to described audio frequency, based on default each play product information in the video of period with Corresponding relation between the audio frequency of corresponding broadcasting period, obtains the corresponding product information of described sound from server and is shown.
10. the product information display systems in a kind of video are it is characterised in that include:
First terminal, second terminal, server;
Described second terminal includes:
Audio frequency receiver module, is playing, for persistently receiving first terminal, the audio frequency play during video;
Synchronous display module, for according to described audio frequency, based on default each play product information in the video of period with Corresponding relation between the audio frequency of corresponding broadcasting period, obtains the corresponding product information of described sound from server and is shown;
Described second terminal is used for playing described video and the audio frequency of described video;
Described server is used for providing described product information.
CN201610915656.5A 2016-10-21 2016-10-21 Product information displaying method, apparatus and system in video Pending CN106341728A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610915656.5A CN106341728A (en) 2016-10-21 2016-10-21 Product information displaying method, apparatus and system in video

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610915656.5A CN106341728A (en) 2016-10-21 2016-10-21 Product information displaying method, apparatus and system in video

Publications (1)

Publication Number Publication Date
CN106341728A true CN106341728A (en) 2017-01-18

Family

ID=57840447

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610915656.5A Pending CN106341728A (en) 2016-10-21 2016-10-21 Product information displaying method, apparatus and system in video

Country Status (1)

Country Link
CN (1) CN106341728A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107728985A (en) * 2017-11-07 2018-02-23 合肥联宝信息技术有限公司 A kind of display control method and electronic equipment
CN110048989A (en) * 2018-01-16 2019-07-23 中兴通讯股份有限公司 A kind of method and device for realizing film interaction projection
CN110600058A (en) * 2019-09-11 2019-12-20 深圳市万睿智能科技有限公司 Method and device for awakening voice assistant based on ultrasonic waves, computer equipment and storage medium
CN114666316A (en) * 2022-03-24 2022-06-24 阿里云计算有限公司 Information processing method, device and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120150890A1 (en) * 2010-12-09 2012-06-14 Electronics And Telecommunications Research Institute Method of searching for multimedia contents and apparatus therefor
CN103152106A (en) * 2013-03-13 2013-06-12 荆效民 Ultrasonic information pushing method and system based on audio
CN104820678A (en) * 2015-04-15 2015-08-05 小米科技有限责任公司 Audio information recognition method and device
CN105812382A (en) * 2016-05-03 2016-07-27 东南和创(厦门)电梯安全科技有限公司 Multimedia push content acquisition method based on ultrasonic
CN105916020A (en) * 2016-05-09 2016-08-31 深圳泽坤信息科技有限公司 Internet application method and system based on video supersonic wave

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120150890A1 (en) * 2010-12-09 2012-06-14 Electronics And Telecommunications Research Institute Method of searching for multimedia contents and apparatus therefor
CN103152106A (en) * 2013-03-13 2013-06-12 荆效民 Ultrasonic information pushing method and system based on audio
CN104820678A (en) * 2015-04-15 2015-08-05 小米科技有限责任公司 Audio information recognition method and device
CN105812382A (en) * 2016-05-03 2016-07-27 东南和创(厦门)电梯安全科技有限公司 Multimedia push content acquisition method based on ultrasonic
CN105916020A (en) * 2016-05-09 2016-08-31 深圳泽坤信息科技有限公司 Internet application method and system based on video supersonic wave

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107728985A (en) * 2017-11-07 2018-02-23 合肥联宝信息技术有限公司 A kind of display control method and electronic equipment
CN110048989A (en) * 2018-01-16 2019-07-23 中兴通讯股份有限公司 A kind of method and device for realizing film interaction projection
CN110600058A (en) * 2019-09-11 2019-12-20 深圳市万睿智能科技有限公司 Method and device for awakening voice assistant based on ultrasonic waves, computer equipment and storage medium
CN114666316A (en) * 2022-03-24 2022-06-24 阿里云计算有限公司 Information processing method, device and storage medium

Similar Documents

Publication Publication Date Title
US10200763B2 (en) Video-based interaction method, terminal, server and system
US11409817B2 (en) Display apparatus and method of controlling the same
CN106507180B (en) A kind of method and terminal of video processing
US10750223B2 (en) System, method, and device for displaying content item
CN109194973A (en) A kind of more main broadcaster's direct broadcasting rooms give the methods of exhibiting, device and equipment of virtual present
CN105979312B (en) Information sharing method and device
CN106686396A (en) Method and system for switching broadcasting rooms
CN103703789A (en) Method, terminal and system of data presentation
CN106572241A (en) Method and device for displaying information
CN105959482B (en) A kind of control method and electronic equipment of scene audio
CN103313139A (en) History display method and device and electronic device
CN106341728A (en) Product information displaying method, apparatus and system in video
CN108399232A (en) A kind of information-pushing method, device and electronic equipment
CN107766455B (en) Lyric pickup method, device and computer readable storage medium
CN108108457A (en) Method, storage medium and the terminal of big beat information are extracted from music beat point
CN106851345B (en) Information pushing method, system and server
CN108388629A (en) A kind of multimedia information push method, device and electronic equipment
CN106791916B (en) Method, device and system for recommending audio data
CN106797336A (en) The method and apparatus of history chat record displaying
CN106792076A (en) It is a kind of enter row information displaying methods, devices and systems
CN106210919A (en) A kind of main broadcaster of broadcasting sings the methods, devices and systems of video
CN110955788A (en) Information display method and electronic equipment
CN109379617A (en) Multimedia file synchronous broadcast method, terminal and medium based on data processing
CN112748970B (en) Message display method and terminal equipment
CN104408051B (en) Song recommendations method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
AD01 Patent right deemed abandoned

Effective date of abandoning: 20200515

AD01 Patent right deemed abandoned