CN107094262A - A kind of wireless medium interactive approach, system and server - Google Patents

A kind of wireless medium interactive approach, system and server Download PDF

Info

Publication number
CN107094262A
CN107094262A CN201610088055.1A CN201610088055A CN107094262A CN 107094262 A CN107094262 A CN 107094262A CN 201610088055 A CN201610088055 A CN 201610088055A CN 107094262 A CN107094262 A CN 107094262A
Authority
CN
China
Prior art keywords
information
data
audio
content
data flow
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610088055.1A
Other languages
Chinese (zh)
Other versions
CN107094262B (en
Inventor
盛亚婷
王天尧
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201610088055.1A priority Critical patent/CN107094262B/en
Priority to CN202110008610.6A priority patent/CN112752144B/en
Publication of CN107094262A publication Critical patent/CN107094262A/en
Application granted granted Critical
Publication of CN107094262B publication Critical patent/CN107094262B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • H04N21/4394Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/233Processing of audio elementary streams
    • H04N21/2335Processing of audio elementary streams involving reformatting operations of audio signals, e.g. by converting from one coding standard to another
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8126Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Telephonic Communication Services (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the present application discloses a kind of wireless medium interactive approach, system and server, and methods described includes:Program emission platform sends first content data and flow to server;Server obtains the first sonic data of the first voice data therein or generation;Server determines fisrt feature information corresponding with first content data flow;First content data flow is sent to first terminal and played by server;Second terminal includes the audio-frequency information of first terminal broadcasting, and the second feature information determined by the audio-frequency information included or according to audio-frequency information is sent to server;Server is matched second feature information with fisrt feature information;When two characteristic information matchings, server pushes the second content information with first content data stream association to second terminal.Wireless medium interactive approach, system and server disclosed in the embodiment of the present application, it is ensured that user easily successfully realizes the interaction with media.

Description

A kind of wireless medium interactive approach, system and server
Technical field
The application is related to media information interaction technique field, more particularly to a kind of wireless medium interactive approach, system and server.
Background technology
With the continuous progress of Internet technology, spectators have been not content with simple visual enjoyment when watching TV, are more desirable to Participate in media program, realize the interaction with media program.
Existing Media method is generally included:While displayable media program, the display TV platform station symbol or two on screen Code is tieed up, the user for watching TV can be using client scan TV station station symbol or Quick Response Codes such as mobile phone, tablet personal computers, according to institute The TV station's station symbol or Quick Response Code of scanning are stated, user can be linked to interaction platform corresponding with currently playing media program, from And realize the interaction with media program.
During the application is realized, inventor has found that at least there are the following problems in the prior art:User uses client scan When TV station's station symbol or Quick Response Code, because the scan frequency of video screen may cause succeed during identification, discrimination is low, uses Family needs Multiple-Scan to succeed.Meanwhile, during customer scans, in order to improve the success rate of identification, it is necessary to ensure client from Video screen is in a nearer scope, and user operates not convenient.
The content of the invention
The purpose of the embodiment of the present application is to provide a kind of wireless medium interactive approach, system and server, to ensure user easily The interaction with media is realized in success.
In order to solve the above technical problems, it is so that the embodiment of the present application, which provides a kind of wireless medium interactive approach, system and server, Realize:
A kind of wireless medium interactive approach, including:
Obtain the first voice data or generation the first sonic data corresponding with first content data flow in first content data flow; The first content data flow includes the voice data of media program;
According to first voice data or the first sonic data, it is determined that fisrt feature information corresponding with first content data flow;
The first content data flow or the first content data flow for being mixed with first sonic data are sent to first terminal Play;
Audio-frequency information or receive the second feature information that second terminal is determined according to the audio-frequency information that reception second terminal is included;
Second feature information being determined according to the audio-frequency information or receiving is matched with the fisrt feature information;
When the second feature information and the fisrt feature information match, the first content is pushed to the second terminal The second content information that data flow is associated in advance.
A kind of wireless medium interaction systems, including:Program emission platform, server, first terminal and second terminal;Wherein,
The program emission platform, server is flow to for sending first content data;
The server, for obtain the first voice data in first content data flow or the generation of acoustic coded device with first in Hold corresponding first sonic data of data flow;The server is according to first voice data or first sonic data, really Fixed fisrt feature information corresponding with first content data flow;The server is by the first content data flow or is mixed with described The first content data flow of first sonic data is sent to first terminal broadcasting;
The first terminal, for receiving and playing the first content data flow or be mixed with first sound that the server sends The first content data flow of wave number evidence;
The second terminal, sends for including the audio-frequency information that the first terminal is played, and by the audio-frequency information included To the server;Or, for including the audio-frequency information that the first terminal is played, second is determined according to the audio-frequency information Characteristic information, and the second feature information is sent to the server;
The server, is additionally operable to receive the audio-frequency information included that the second terminal sends or second that second terminal is sent is special Reference ceases, by second feature information being determined according to the audio-frequency information or receiving and fisrt feature information progress Match somebody with somebody;When the second feature information and the fisrt feature information match, the server pushes institute to the second terminal State the second content information that first content data flow is associated in advance.
A kind of wireless medium interactive service device, including:Audio/sonic data acquisition module, fisrt feature information determination module, One content stream data sending module, information receiving module, characteristic information matching module and the second content information pushing module;Wherein,
The audio/sonic data acquisition module, for obtaining voice data or generation and first content in first content data flow The corresponding sonic data of data flow;
The fisrt feature information determination module, for the first voice data in the audio/sonic data acquisition module or First sonic data, it is determined that fisrt feature information corresponding with first content data flow;
The first content data flow sending module, for by the first content data flow or being mixed with first sonic data First content data flow be sent to first terminal broadcasting;
Described information receiving module, believes for receiving audio-frequency information that second terminal includes or receiving second terminal according to the audio Cease the second feature information determined;
The characteristic information matching module, for by according to receiving audio-frequency information the is determined or letter in described information receiving module The second feature information that breath receiving module is received is matched with the fisrt feature information;
The second content information pushing module, for when second feature information and described first in the characteristic information matching module When characteristic information matches, the second content information that the first content data flow is associated in advance is pushed to the second terminal.
The technical scheme provided from above the embodiment of the present application, a kind of wireless medium interaction side that the embodiment of the present application is provided Method, system server and client, the second terminal that user can use in user utilize the mode of voice data or sonic data It is attached with media program, realizes the wireless interactive of media, volume when user plays media program can ensures client completely End can be indexed to the voice data related to interaction content, it is thus possible to improve user is connected to the successful of Media content, Ensure that user can successfully realize Media.Meanwhile, the method that the embodiment of the present application is provided only needs second terminal with playing matchmaker The distance between first terminal of body can collect voice data, and user is easy to operate.On the other hand, the application is implemented Example provide wireless medium interactive approach, by sonic data directly with first content datastream, it is not necessary to first content number It is compressed etc. according to stream and damages processing, audiovisual will not be caused to influence the broadcasting of media program.
Brief description of the drawings
, below will be to embodiment or prior art in order to illustrate more clearly of the embodiment of the present application or technical scheme of the prior art The accompanying drawing used required in description is briefly described, it should be apparent that, drawings in the following description are only note in the application Some embodiments carried, for those of ordinary skill in the art, without having to pay creative labor, can be with Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is the composition schematic diagram of the application wireless medium interaction systems one embodiment;
Fig. 2 is the flow chart of the application wireless medium interactive approach one embodiment;
Fig. 3 is the flow chart of wireless medium interactive approach embodiment of the application based on server;
Fig. 4 is the module map of server one embodiment in the application wireless medium interaction systems.
Embodiment
The embodiment of the present application provides a kind of wireless medium interactive approach, system and server.
In order that those skilled in the art more fully understand the technical scheme in the application, below in conjunction with the embodiment of the present application Accompanying drawing, the technical scheme in the embodiment of the present application is clearly and completely described, it is clear that described embodiment is only It is some embodiments of the present application, rather than whole embodiments.Based on the embodiment in the application, ordinary skill people The every other embodiment that member is obtained under the premise of creative work is not made, should all belong to the scope of the application protection.
Fig. 1 is the composition schematic diagram of the application wireless medium interaction systems one embodiment.The application wireless medium is shown in Fig. 1 Data cube computation relation in interaction systems between each device.
Fig. 2 is the flow chart of the application wireless medium interactive approach one embodiment.As shown in Fig. 2 the wireless medium interaction side Method can include:
S101:Program emission platform sends first content data and flow to server.
The first content data flow can be used for describing media program content.The first content data flow can include the matchmaker Body segment purpose voice data.The first content data flow can also include the picture data and/or media program of the media program Programme information.
The programme information can include:Program identification, programm name and/or program broadcasting time.
Program emission platform can send first content data and flow to server.
S102:The server obtain the first voice data in first content data flow or the generation of acoustic coded device with first in Hold corresponding first sonic data of data.
The server obtains the first voice data in first content data flow, can include:The server obtains described the All or part of content of one content stream data sound intermediate frequency data, regard all or part of voice data of the acquisition as the first sound Frequency evidence.For example, can obtain is used to remind user to participate in the interactive voice data conduct of media program in first content data flow First voice data.
The first sonic data corresponding with first content data flow of the generation can be according in the first content data flow Programme information is generated using acoustic coded device.For example, the sound can be utilized according to the program identification or the programm name Ripple encoder generates the first sonic data.
Further, the frequency of sound wave of the sonic data can be located at the audio frequency range that human ear can not hear.
S103:The server according to first voice data or first sonic data, it is determined that with first content data flow Corresponding fisrt feature information.
The server can according to first voice data or first sonic data, it is determined that with first content data flow pair The fisrt feature information answered.
Specifically:When the server obtain be the first voice data when, can according to the first extracting rule extract described first The audio feature information of voice data, regard the audio feature information as fisrt feature information;Or, when the server is obtained Take be the first sonic data when, can will be used as fisrt feature information or can be right for generating the information of the sonic data The sonic data is decoded, and regard the information obtained by decoding as fisrt feature information.For example, can be used to generate by described The program identification of sonic data is used as fisrt feature information.
The audio feature information according to first the first voice data of Rule Extraction, can specifically include:To first audio Data carry out Fourier transform frame by frame;In a frequency domain, in each frame for extracting the first voice data after the Fourier transform Closely spaced frequencies point;The closely spaced frequencies point extracted in adjacent two frame of the first voice data after the Fourier transform is constituted and handed over Fork vector;It regard the vector that intersects as fisrt feature information.
Determine after fisrt feature information, the corresponding relation of first content data flow and the fisrt feature information can be set up.Need Illustrate, the first content data flow and described ground fisrt feature information can be man-to-man corresponding relation or One-to-many corresponding relation.
S104:The server is by the first content data flow or is mixed with the first content data flow of first sonic data It is sent to first terminal broadcasting.
The first terminal can be the playback equipment for playing first content data flow.For example, it may be television set, flat board The equipment such as computer, mobile phone.
The first content data flow can be sent to first terminal and played out by the server.When server is obtained described in S102 When having got the first sonic data corresponding with first content data of acoustic coded device generation, the server will can also be mixed The first content data flow for having first sonic data is sent to first terminal and played out.
The first content data flow for being mixed with the first sonic data can include:Is superimposed in the first content data flow First content data flow after one sonic data.
It is possible to further mix once the first sound wave number in the first content data flow every prefixed time interval According to;Or, first sonic data can be superimposed upon in the first voice data of the first content data flow.
It is described when first sonic data is mixed to first content data flow, the first sonic data is superimposed to first content data Stream, it is not necessary to the data processing such as first content data flow is compressed or encoded, therefore, first content data will not be produced Damage, when playing the first content data flow, does not interfere with the audio visual effect of program.
S105:The first terminal receives and played the first content data flow or be mixed with first sound that the server sends The first content data flow of wave number evidence.
S106:Second terminal includes the audio-frequency information that the first terminal is played, and by the audio-frequency information included or according to institute The second feature information for stating audio-frequency information determination is sent to server.
Second terminal can be the multimedia equipment for possessing sound-recording function.The equipment such as can be mobile phone or tablet personal computer.
In another embodiment, the second terminal can start to include institute after the trigger signal for starting to gather information is received State the audio-frequency information of first terminal broadcasting.The trigger signal can be user's actively triggering.Shaken for example, user can be received The vibration signal of mobile phone, either the toggle area on user's touch second terminal display screen or user's triggering described second must Trigger button etc..
The trigger signal can also include:Second terminal is opened on backstage.
Second terminal is received after the trigger signal, can include the audio-frequency information of first terminal broadcasting.
The audio-frequency information that the second terminal is included can include:Second audio data or the second sound for being mixed with the second sonic data Frequency evidence.
The second terminal can send the audio-frequency information included to server.
In another embodiment, the second terminal can determine second feature information according to the audio-frequency information included, hair The second feature information is sent to server.
The audio-frequency information that the basis is included determines second feature information, can specifically include:When the audio-frequency information bag included When including second audio data, the characteristic information of second audio data can be extracted according to the first extracting rule, by the spy of the extraction Reference breath is used as second feature information;Or, when the audio-frequency information included is the second audio for being mixed with the second sonic data During data, second sonic data can be decoded, the information that the decoding is obtained is used as second feature information.
S107:The server can receive second that the audio-frequency information included that the second terminal sends or second terminal are sent Characteristic information.
S108:The server is by second feature information being determined according to the audio-frequency information or receiving and the fisrt feature Information is matched.
The server can be by second feature information being determined according to the audio-frequency information or receiving and the fisrt feature Information is matched.
, can be by the second feature information if the second feature information sent for the second terminal that the server is received Matched with the fisrt feature information.
If the audio-frequency information included sent for the second terminal that the server is received, can be according to the audio-frequency information Second feature information is determined, and the second feature information is matched with fisrt feature information.
It is described that second feature information is determined according to audio-frequency information, can be with second terminal in step S106 according to the audio-frequency information included The method for determining second feature information is identical, and the application will not be repeated here.
S109:When the second feature information and during the fisrt feature information match, the server is to the second terminal Push the second content information associated in advance with the first content data flow.
When the second feature information with the fisrt feature information match is that the server can be pushed away to the second terminal Send the second content information associated in advance with the first content data flow.Second content information can include:First content The interactive content information of data flow.For example, it may be interactive message or the interactive page etc..
A kind of wireless medium interactive approach of the application based on server is described below.
Fig. 3 is the flow chart of wireless medium interactive approach embodiment of the application based on server.As shown in figure 3, the side Method can include:
S201:Obtain the first voice data or generation the first sound wave corresponding with first content data flow in first content data flow Data.
S202:According to first voice data or the first sonic data, it is determined that fisrt feature corresponding with first content data flow Information.
S203:The first content data flow or the first content data flow for being mixed with first sonic data are sent to first Terminal plays.
S204:Audio-frequency information or receive the second feature that second terminal is determined according to the audio-frequency information that reception second terminal is included Information.
S205:By second feature information being determined according to the audio-frequency information or receiving and fisrt feature information progress Match somebody with somebody.
S206:When the second feature information and during the fisrt feature information match, described the is pushed to the second terminal The second content information that one content stream data is associated in advance.
The particular content of each step is referred to the wireless medium interactive approach embodiment shown in Fig. 1, the application in above-described embodiment It will not be repeated here.
The wireless medium interactive approach that above-described embodiment is provided, the second terminal that user can use in user using voice data or The mode of sonic data is attached with media program, realizes the wireless interactive of media, and volume during user's broadcasting media program is complete It can ensure that client can be indexed to the voice data related to interaction content entirely, it is thus possible to improve to be connected to media mutual by user The successful of dynamic content, it is ensured that user can successfully realize Media.Meanwhile, the method that the embodiment of the present application is provided only is needed The distance between the first terminal of second terminal with playing media can collect voice data, and user is easy to operate.It is another Aspect, the embodiment of the present application provide wireless medium interactive approach, by sonic data directly with first content datastream, no Need to be compressed first content data flow etc. and damage processing, audiovisual will not be caused to influence the broadcasting of media program.
A kind of wireless medium interaction systems of the application are described below.Fig. 1 is the application wireless medium interaction systems one embodiment Composition schematic diagram.As shown in figure 1, the wireless medium interaction systems can include:Program emission platform 100, server 200, First terminal 300 and second terminal 400.
Wherein,
The program emission platform 100, can be used for transmission first content data and flow to server 200.
The server 200, the first voice data that can be used for obtaining in first content data flow or the generation of acoustic coded device The first sonic data corresponding with first content data flow;The server 200 is according to first voice data or described first Sonic data, it is determined that fisrt feature information corresponding with first content data flow;The server 200 is by the first content number First terminal 300 is sent to according to the first content data flow for flowing or being mixed with first sonic data to play;
The first terminal 300, can be used for receiving and plays first content data flow or be mixed with that the server 200 sends The first content data flow of first sonic data.
The second terminal 400, can be used for including the audio-frequency information that the first terminal 300 is played, and by the sound included Frequency information is sent to the server 200;Or, it can be used for including the audio-frequency information that the first terminal 300 is played, according to The audio-frequency information determines second feature information, and the second feature information is sent to the server 200.
The server 200 is additionally operable to receive the audio-frequency information included that the second terminal 400 sends or second terminal 400 is sent out The second feature information come, second feature information being determined according to the audio-frequency information or receiving and the fisrt feature are believed Breath is matched;When the second feature information and during the fisrt feature information match, the server 200 is to described the Two terminals 400 push the second content information that the first content data flow is associated in advance.
Fig. 4 is the module map of server one embodiment in the application wireless medium interaction systems.As shown in figure 4, the server 200 can include:Audio/sonic data acquisition module 201, fisrt feature information determination module 202, first content data flow hair Send module 203, information receiving module 204, the content information pushing module 206 of characteristic information matching module 205 and second.
Wherein,
The audio/sonic data acquisition module 201, can be used for obtain first content data flow in voice data or generation with The corresponding sonic data of first content data flow.
The fisrt feature information determination module 202, first can be used in the audio/sonic data acquisition module 201 Voice data or the first sonic data, it is determined that fisrt feature information corresponding with first content data flow.
The first content data flow sending module 203, can be used for the first content data flow or is mixed with described first The first content data flow of sonic data is sent to first terminal 300 and played.
Described information receiving module 204, can be used for receiving audio-frequency information or the reception second terminal 400 that second terminal 400 is included The second feature information determined according to the audio-frequency information.
The characteristic information matching module 205, can be used for will be true according to audio-frequency information is received in described information receiving module 204 The second feature information that fixed or described information receiving module 204 is received is matched with the fisrt feature information.
The second content information pushing module 206, can be used for working as second feature in the characteristic information matching module 205 and believes When breath is with the fisrt feature information match, push what the first content data flow was associated in advance to the second terminal 400 Second content information.
The wireless medium interaction systems of above-described embodiment offer, each method embodiment phase of server and client side respectively with the application Correspondence, it is possible to achieve the application embodiment of the method and the technique effect for reaching embodiment of the method.The application will not be repeated here.
In the 1990s, can clearly to distinguish be improvement on hardware (for example, to two for the improvement of a technology The improvement of the circuit structures such as pole pipe, transistor, switch) or software on improvement (for the improvement of method flow).However, With the development of technology, the improvement of current many method flows can be considered as directly improving for hardware circuit.Design Personnel nearly all obtain corresponding hardware circuit by the way that improved method flow is programmed into hardware circuit.Therefore, no The improvement of a method flow, which can be said, to be realized with hardware entities module.For example, PLD (Programmable Logic Device, PLD) (such as field programmable gate array (Field Programmable Gate Array, FPGA)) it is exactly such a integrated circuit, its logic function is determined by user to device programming.By designer Voluntarily programming comes a digital display circuit " integrated " on a piece of PLD member, without asking chip maker to design and make Make special IC chip 2.Moreover, nowadays, substitution manually makes IC chip, and this programming also changes mostly Realized with " logic compiler (logic compiler) " software, software compiler phase used when it writes with program development It is similar, and also handy specific programming language is write for source code before compiling, this is referred to as hardware description language (Hardware Description Language, HDL), and HDL is also not only a kind of, but have many kinds, such as ABEL (Advanced Boolean Expression Language)、AHDL(Altera Hardware Description Language)、 Confluence、CUPL(Cornell University Programming Language)、HDCal、JHDL(Java Hardware Description Language)、Lava、Lola、MyHDL、PALASM、RHDL(Ruby Hardware Description Language) etc., VHDL (Very-High-Speed Integrated Circuit Hardware are most generally used at present Description Language) and Verilog2.Those skilled in the art, which also will be apparent to the skilled artisan that, to be only needed to method flow with above-mentioned Several hardware description languages slightly programming in logic and are programmed into integrated circuit, it is possible to be readily available and realized the logical method stream The hardware circuit of journey.
Controller can be implemented in any suitable manner, for example, controller can take such as microprocessor or processor and Storage can by the computer readable program code (such as software or firmware) of (micro-) computing device computer-readable medium, Gate, switch, application specific integrated circuit (Application Specific Integrated Circuit, ASIC), FPGA The form of controller and embedded microcontroller, the example of controller includes but is not limited to following microcontroller:ARC 625D、Atmel AT91SAM, Microchip PIC18F26K20 and Silicone Labs C8051F320, Memory Controller can also quilt It is embodied as a part for the control logic of memory.
, completely can be with it is also known in the art that in addition to realizing controller in pure computer readable program code mode Cause controller with gate, switch, application specific integrated circuit, FPGA control by the way that method and step is carried out into programming in logic Device processed realizes identical function with the form of embedded microcontroller etc..Therefore this controller is considered a kind of Hardware Subdivision Part, and the structure in hardware component can also be considered as to the device for realizing various functions included in it.Or even, can Not only can will be the software module of implementation method but also can be the knot in hardware component for realizing that the device of various functions is considered as Structure.
System, device, module or unit that above-described embodiment is illustrated, can specifically be realized by computer chip or entity, or Realized by the product with certain function.
For convenience of description, it is divided into various units during description apparatus above with function to describe respectively.Certainly, the application is being implemented When the function of each unit can be realized in same or multiple softwares and/or hardware.
As seen through the above description of the embodiments, those skilled in the art can be understood that the application can be by soft Part adds the mode of required general hardware platform to realize.Understood based on such, the technical scheme of the application is substantially in other words The part contributed to prior art can be embodied in the form of software product, and in a typical configuration, calculating is set It is standby to include one or more processors (CPU), input/output interface, network interface and internal memory.The computer software product can be with Including some instructions to cause a computer equipment (can be personal computer, server, or network equipment etc.) to hold Method described in some parts of each embodiment of row the application or embodiment.The computer software product can be stored in internal memory In, internal memory potentially includes the volatile memory in computer-readable medium, random access memory (RAM) and/or non-volatile The forms, such as read-only storage (ROM) or flash memory (flash RAM) such as property internal memory.Internal memory is the example of computer-readable medium.Meter Calculation machine computer-readable recording medium, which includes permanent and non-permanent, removable and non-removable media, to be realized by any method or technique Information is stored.Information can be computer-readable instruction, data structure, the module of program or other data.The storage of computer The example of medium includes, but are not limited to phase transition internal memory (PRAM), static RAM (SRAM), dynamic randon access Memory (DRAM), other kinds of random access memory (RAM), read-only storage (ROM), electrically erasable Read-only storage (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc read-only storage (CD-ROM), numeral Multifunctional optical disk (DVD) or other optical storages, magnetic cassette tape, the storage of tape magnetic rigid disk or other magnetic storage apparatus are appointed What his non-transmission medium, the information that can be accessed by a computing device available for storage.Defined according to herein, computer can Reading medium does not include the data-signal and carrier wave of of short duration computer readable media (transitory media), such as modulation.
Each embodiment in this specification is described by the way of progressive, and identical similar part is mutual between each embodiment Referring to what each embodiment was stressed is the difference with other embodiment.Especially for system embodiment Speech, because it is substantially similar to embodiment of the method, so description is fairly simple, referring to the part of embodiment of the method in place of correlation Explanation.
The application can be used in numerous general or special purpose computing system environments or configuration.For example:Personal computer, server Computer, handheld device or portable set, laptop device, multicomputer system, the system based on microprocessor, top set Box, programmable consumer-elcetronics devices, network PC, minicom, mainframe computer including any of the above system or equipment DCE etc..
The application can be described in the general context of computer executable instructions, such as program module. Usually, program module include performing particular task or realize the routine of particular abstract data type, program, object, component, Data structure etc..The application can also be put into practice in a distributed computing environment, in these DCEs, by passing through Communication network and connected remote processing devices perform task.In a distributed computing environment, program module can be located at bag Include in the local and remote computer-readable storage medium including storage device.
Although depicting the application by embodiment, it will be appreciated by the skilled addressee that the application have it is many deformation and change and Spirit herein is not departed from, it is desirable to which appended claim includes these deformations and changed without departing from spirit herein.

Claims (15)

1. a kind of wireless medium interactive approach, it is characterised in that including:
Obtain the first voice data or generation the first sonic data corresponding with first content data flow in first content data flow; The first content data flow includes the voice data of media program;
According to first voice data or the first sonic data, it is determined that fisrt feature information corresponding with first content data flow;
The first content data flow or the first content data flow for being mixed with first sonic data are sent to first terminal Play;
Audio-frequency information or receive the second feature information that second terminal is determined according to the audio-frequency information that reception second terminal is included;
Second feature information being determined according to the audio-frequency information or receiving is matched with the fisrt feature information;
When the second feature information and the fisrt feature information match, the first content is pushed to the second terminal The second content information that data flow is associated in advance.
2. a kind of wireless medium interactive approach as claimed in claim 1, it is characterised in that the first content data flow is also Including:The picture data of the media program and/or the programme information of media program.
3. a kind of wireless medium interactive approach as claimed in claim 2, it is characterised in that the programme information includes:Section Target knowledge, programm name and/or program broadcasting time.
4. a kind of wireless medium interactive approach as claimed in claim 2, it is characterised in that the generation and first content number According to corresponding first sonic data of stream, including:Programme information in the first content data flow is given birth to using acoustic coded device Into the first sonic data.
5. a kind of wireless medium interactive approach as claimed in claim 1, it is characterised in that the acquisition first content data The first voice data in stream, including:The server obtains all or part of the first content data flow sound intermediate frequency data Content, regard all or part of voice data of the acquisition as the first voice data.
6. a kind of wireless medium interactive approach as claimed in claim 1, it is characterised in that the server is according to described the One voice data or first sonic data determine fisrt feature information corresponding with first content data flow, including:
When the server obtain be the first voice data when, the sound of first voice data is extracted according to the first extracting rule Frequency characteristic information, regard the audio feature information as fisrt feature data message;
Or,
When the server generate obtain be the first sonic data when, using for generate the data message of the sonic data as Fisrt feature data message, or, the sonic data is decoded, the information obtained by decoding is regard as fisrt feature information.
7. a kind of wireless medium interactive approach as claimed in claim 1, it is characterised in that described to be mixed with the first sound wave number According to first content data flow include:The first content data after the first sonic data are superimposed in the first content data flow Stream.
8. a kind of wireless medium interactive approach as claimed in claim 7, it is characterised in that described in first content data flow The first sonic data of middle superposition includes:First sound is mixed once in the first content data flow every prefixed time interval Wave number evidence.
9. a kind of wireless medium interactive approach as claimed in claim 7, it is characterised in that described in first content data flow The first sonic data of middle superposition includes:First sonic data is superimposed upon to the first voice data of the first content data flow In.
10. a kind of wireless medium interactive approach as claimed in claim 1, it is characterised in that the sound that the second terminal is included Frequency information includes:Second audio data or the second audio data for being mixed with the second sonic data.
11. a kind of wireless medium interactive approach as claimed in claim 10, it is characterised in that the audio that the basis is included Information determines second feature information, specifically includes:
When the audio-frequency information included includes second audio data, the spy that second audio data is extracted according to the first extracting rule Reference ceases, and regard the characteristic information of the extraction as second feature information;Or,
When the audio-frequency information included is to be mixed with the second audio data of the second sonic data, to second sonic data Decoded, the information that the decoding is obtained is used as second feature information.
12. a kind of wireless medium interactive approach as described in claim 6 or 11, it is characterised in that first rule is carried The characteristic information of voice data is taken, is specifically included:
Fourier transform is carried out frame by frame to the voice data;
In a frequency domain, the closely spaced frequencies point in each frame of the voice data after the Fourier transform is extracted;
The closely spaced frequencies point extracted in adjacent two frame of voice data after the Fourier transform composition is intersected into vector;
It regard the vector that intersects as characteristic information.
13. a kind of wireless medium interactive approach as claimed in claim 1, it is characterised in that the first content data flow with Described ground fisrt feature information is man-to-man corresponding relation, or one-to-many corresponding relation.
14. a kind of wireless medium interaction systems, it is characterised in that including:Program emission platform, server, first terminal and Second terminal;Wherein,
The program emission platform, server is flow to for sending first content data;
The server, for obtain the first voice data in first content data flow or the generation of acoustic coded device with first in Hold corresponding first sonic data of data flow;The server is according to first voice data or first sonic data, really Fixed fisrt feature information corresponding with first content data flow;The server is by the first content data flow or is mixed with described The first content data flow of first sonic data is sent to first terminal broadcasting;
The first terminal, for receiving and playing the first content data flow or be mixed with first sound that the server sends The first content data flow of wave number evidence;
The second terminal, sends for including the audio-frequency information that the first terminal is played, and by the audio-frequency information included To the server;Or, for including the audio-frequency information that the first terminal is played, second is determined according to the audio-frequency information Characteristic information, and the second feature information is sent to the server;
The server, is additionally operable to receive the audio-frequency information included that the second terminal sends or second that second terminal is sent is special Reference ceases, by second feature information being determined according to the audio-frequency information or receiving and fisrt feature information progress Match somebody with somebody;When the second feature information and the fisrt feature information match, the server pushes institute to the second terminal State the second content information that first content data flow is associated in advance.
15. a kind of wireless medium interactive service device, it is characterised in that including:Audio/sonic data acquisition module, fisrt feature Information determination module, first content data flow sending module, information receiving module, characteristic information matching module and the second content letter Cease pushing module;Wherein,
The audio/sonic data acquisition module, for obtaining voice data or generation and first content in first content data flow The corresponding sonic data of data flow;
The fisrt feature information determination module, for the first voice data in the audio/sonic data acquisition module or First sonic data, it is determined that fisrt feature information corresponding with first content data flow;
The first content data flow sending module, for by the first content data flow or being mixed with first sonic data First content data flow be sent to first terminal broadcasting;
Described information receiving module, believes for receiving audio-frequency information that second terminal includes or receiving second terminal according to the audio Cease the second feature information determined;
The characteristic information matching module, for by according to receiving audio-frequency information the is determined or letter in described information receiving module The second feature information that breath receiving module is received is matched with the fisrt feature information;
The second content information pushing module, for when second feature information and described first in the characteristic information matching module When characteristic information matches, the second content information that the first content data flow is associated in advance is pushed to the second terminal.
CN201610088055.1A 2016-02-17 2016-02-17 Wireless media interaction method, system and server Active CN107094262B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201610088055.1A CN107094262B (en) 2016-02-17 2016-02-17 Wireless media interaction method, system and server
CN202110008610.6A CN112752144B (en) 2016-02-17 2016-02-17 Wireless media interaction method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610088055.1A CN107094262B (en) 2016-02-17 2016-02-17 Wireless media interaction method, system and server

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202110008610.6A Division CN112752144B (en) 2016-02-17 2016-02-17 Wireless media interaction method and system

Publications (2)

Publication Number Publication Date
CN107094262A true CN107094262A (en) 2017-08-25
CN107094262B CN107094262B (en) 2021-02-12

Family

ID=59645973

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201610088055.1A Active CN107094262B (en) 2016-02-17 2016-02-17 Wireless media interaction method, system and server
CN202110008610.6A Active CN112752144B (en) 2016-02-17 2016-02-17 Wireless media interaction method and system

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202110008610.6A Active CN112752144B (en) 2016-02-17 2016-02-17 Wireless media interaction method and system

Country Status (1)

Country Link
CN (2) CN107094262B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108769262A (en) * 2018-07-04 2018-11-06 厦门声连网信息科技有限公司 A kind of big screen information supplying system, large screen device and method
CN108833964A (en) * 2018-06-11 2018-11-16 阿依瓦(北京)技术有限公司 A kind of real-time successive frame Information Embedding identifying system
CN112637147A (en) * 2020-12-13 2021-04-09 青岛希望鸟科技有限公司 Method, terminal and server for establishing and connecting communication service through audio
WO2023102804A1 (en) * 2021-12-09 2023-06-15 青岛希望鸟科技有限公司 Method for creating and connecting communication service through audio, and terminal and server

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103123787A (en) * 2011-11-21 2013-05-29 金峰 Method for synchronizing and exchanging mobile terminal with media
CN103402118A (en) * 2013-07-05 2013-11-20 Tcl集团股份有限公司 Media program interaction method and system
CN103873935A (en) * 2012-12-17 2014-06-18 联想(北京)有限公司 Data processing method and device
CN104378683A (en) * 2014-05-29 2015-02-25 腾讯科技(深圳)有限公司 Program based interaction method and device
CN104519373A (en) * 2014-12-16 2015-04-15 微梦创科网络科技(中国)有限公司 Media program interaction method and related equipment

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6393137B1 (en) * 1999-06-17 2002-05-21 Raytheon Company Multi-resolution object classification method employing kinematic features and system therefor
US8593502B2 (en) * 2006-01-26 2013-11-26 Polycom, Inc. Controlling videoconference with touch screen interface
US9965524B2 (en) * 2013-04-03 2018-05-08 Salesforce.Com, Inc. Systems and methods for identifying anomalous data in large structured data sets and querying the data sets
CN103763586B (en) * 2014-01-16 2017-05-10 北京酷云互动科技有限公司 Television program interaction method and device and server
CN104050259A (en) * 2014-06-16 2014-09-17 上海大学 Audio fingerprint extracting method based on SOM (Self Organized Mapping) algorithm

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103123787A (en) * 2011-11-21 2013-05-29 金峰 Method for synchronizing and exchanging mobile terminal with media
CN103873935A (en) * 2012-12-17 2014-06-18 联想(北京)有限公司 Data processing method and device
CN103402118A (en) * 2013-07-05 2013-11-20 Tcl集团股份有限公司 Media program interaction method and system
CN104378683A (en) * 2014-05-29 2015-02-25 腾讯科技(深圳)有限公司 Program based interaction method and device
CN104519373A (en) * 2014-12-16 2015-04-15 微梦创科网络科技(中国)有限公司 Media program interaction method and related equipment

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108833964A (en) * 2018-06-11 2018-11-16 阿依瓦(北京)技术有限公司 A kind of real-time successive frame Information Embedding identifying system
CN108769262A (en) * 2018-07-04 2018-11-06 厦门声连网信息科技有限公司 A kind of big screen information supplying system, large screen device and method
CN108769262B (en) * 2018-07-04 2023-11-17 厦门声连网信息科技有限公司 Large-screen information pushing system, large-screen equipment and method
CN112637147A (en) * 2020-12-13 2021-04-09 青岛希望鸟科技有限公司 Method, terminal and server for establishing and connecting communication service through audio
CN112637147B (en) * 2020-12-13 2022-08-05 青岛希望鸟科技有限公司 Method, terminal and server for establishing and connecting communication service through audio
WO2023102804A1 (en) * 2021-12-09 2023-06-15 青岛希望鸟科技有限公司 Method for creating and connecting communication service through audio, and terminal and server

Also Published As

Publication number Publication date
CN107094262B (en) 2021-02-12
CN112752144A (en) 2021-05-04
CN112752144B (en) 2024-03-08

Similar Documents

Publication Publication Date Title
CN110457457B (en) Training method of dialogue generation model, dialogue generation method and device
KR101679239B1 (en) Apparatus and method for playing on musical instruments by augmented reality in portable terminal
CN107094262A (en) A kind of wireless medium interactive approach, system and server
KR101991188B1 (en) Promotion information processing method, device, and apparatus, and non-volatile computer storage medium
TW201132122A (en) System and method in a television for providing user-selection of objects in a television program
CN106170094B (en) Live broadcasting method and device for panoramic video
KR20100122486A (en) Techniques to consume content and metadata
CN108924661A (en) Data interactive method, device, terminal and storage medium based on direct broadcasting room
WO2014176747A1 (en) Enabling an interactive program associated with a live broadcast on a mobile device
CN111629253A (en) Video processing method and device, computer readable storage medium and electronic equipment
CN106470284A (en) Eliminate method, device, system, server and the communicator of acoustic echo
US20170180445A1 (en) Advertisement data acquisition method and electronic equipment
CN103108229A (en) Method for identifying video contents in cross-screen mode through audio frequency
CN109195009B (en) Audio and video playing method and playing system, intelligent sound box and storage device
US11886484B2 (en) Music playing method and apparatus based on user interaction, and device and storage medium
CN110121106A (en) Video broadcasting method and device
CN110139164A (en) A kind of voice remark playback method, device, terminal device and storage medium
CN105893430A (en) Lyrics matching method and device
US9223458B1 (en) Techniques for transitioning between playback of media files
CN113099250B (en) Information processing method and electronic equipment
CN108519813A (en) A kind of protection cervical vertebra method based on hand-held intelligent equipment
CN116257159A (en) Multimedia content sharing method, device, equipment, medium and program product
CN112866793A (en) Media mode switching method, device, equipment and storage medium
WO2020133783A1 (en) Monitoring method and apparatus based on wearable device, and electronic device
CN108965911B (en) Video and audio data acquisition method based on authorization code

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1240000

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant