CN106060627A - Audio processing method and device based on multi-way live broadcast - Google Patents

Audio processing method and device based on multi-way live broadcast Download PDF

Info

Publication number
CN106060627A
CN106060627A CN201610425402.5A CN201610425402A CN106060627A CN 106060627 A CN106060627 A CN 106060627A CN 201610425402 A CN201610425402 A CN 201610425402A CN 106060627 A CN106060627 A CN 106060627A
Authority
CN
China
Prior art keywords
signal source
quiet
decoded
target signal
decoder
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610425402.5A
Other languages
Chinese (zh)
Inventor
曹虹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Leshi Zhixin Electronic Technology Tianjin Co Ltd
LeTV Holding Beijing Co Ltd
Original Assignee
Leshi Zhixin Electronic Technology Tianjin Co Ltd
LeTV Holding Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Leshi Zhixin Electronic Technology Tianjin Co Ltd, LeTV Holding Beijing Co Ltd filed Critical Leshi Zhixin Electronic Technology Tianjin Co Ltd
Priority to CN201610425402.5A priority Critical patent/CN106060627A/en
Publication of CN106060627A publication Critical patent/CN106060627A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/426Internal components of the client ; Characteristics thereof
    • H04N21/42607Internal components of the client ; Characteristics thereof for processing the incoming bitstream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • H04N21/4396Processing of audio elementary streams by muting the audio signal

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the invention provides an audio processing method and device based on multi-way live broadcast. The method specifically comprises the steps of receiving a playing instruction for multi-way signal sources; judging whether each signal source needs to be played mutely or not; zeroing an audio decoding result corresponding to a target signal source, for the target signal source needing to be played mutely; and outputting mute of the target signal source according to the audio decoding result. According to the embodiment of the method and the device, the terminal resources such as a CPU and a memory occupied by audio decoding operation of the target signal source can be reduced; the power consumption of the smart terminal is reduced; and the performance of the smart terminal is improved.

Description

A kind of audio-frequency processing method live based on multichannel and device
Technical field
The present embodiments relate to multimedia technology field, particularly relate to a kind of audio-frequency processing method live based on multichannel And device.
Background technology
Along with Internet technology and the development of smart television set top box technology and universal, by PC (personal computer, Personal Computer) or the intelligent terminal such as intelligent television watch network direct broadcasting and have become as popular viewing programme televised live Main flow selects.Comparing traditional live television programs, network direct broadcasting has the advantage bigger from main separation space of user, therefore The news briefing that is widely used in carrying out in real time, exhibition, product issue, product recommendations, sale outpost display, network are sung Meeting, company's cocktail party, business meetings, celebration ceremony, program performance, movies-making, sports tournament, security analysis, long-distance education etc. In network direct broadcasting service.
In order to improve the viewing experience of user, can support that multichannel is live at present, it is concrete that what this multichannel was live realizes process Including: obtain the signal source of multi-channel video signal, according to the broadcasting priority of the signal source of each road video signal locally displayed Corresponding video data;Wherein, same dynamic event can be carried out with different view by multi-channel video signal by video capture device Collect.
In current multichannel live scene, can support that user selects a road to have the video of limit priority (below It is called for short focus video), and respectively non-focus video relatively low to this focus video and priority is shown at screen by player Middle section and two side areas.Further, in order to avoid the sound of this non-focus video is for the interference of the sound of focus video, The volume of this focus video is set greater than the default volume of 0 by existing scheme by this player, and by this non-focus video Volume be set to quiet.
But, although the volume of this non-focus video is set to quiet by this player of existing scheme, but this player Audio processing modules (such as audio decoder) still work, such as, audio decoder need nonetheless remain for regarding this non-focus The voice data of frequency carries out audio decoder computing, therefore these audio processing modules still can take the CPU of intelligent terminal, increase intelligence The power consumption of energy terminal, and then affect the performance of intelligent terminal.
Summary of the invention
The embodiment of the present invention provides a kind of audio-frequency processing method live based on multichannel and device, in order to solve existing scheme Sound intermediate frequency decoding computing takies CPU, increases power consumption and affect the technical problem of performance, can save the audio frequency solution of target signal source The terminal resources such as code CPU shared by computing, internal memory, reduce the power consumption of intelligent terminal, and then improve the performance of intelligent terminal.
The embodiment of the present invention provides a kind of audio-frequency processing method live based on multichannel, including:
Receive the play instruction for multipath signal source;
Judge that each road signal source is the need of quiet broadcasting;
For the target signal source of the quiet broadcasting of needs, by the audio decoder result zero setting of its correspondence;
According to described audio decoder result, export the quiet of described target signal source.
Alternatively, the described target signal source for the quiet broadcasting of needs, by the audio decoder result zero setting of its correspondence Step, including:
For the target signal source of the quiet broadcasting of needs, according to playing duration and the lattice of its corresponding voice data to be decoded Formula, determines the length of corresponding audio frequency decoded result;
Create storage organization, and by the element zero setting of described storage organization;The number of the comprised element of described storage organization Consistent with the length of described audio decoder result.
Alternatively, in the described target signal source for the quiet broadcasting of needs, by the audio decoder result zero setting of its correspondence Step before, described method also includes:
For the target signal source of the quiet broadcasting of needs, generate corresponding preset quiet labelling;
Create the first decoder;
Voice data to be decoded corresponding to described target signal source and preset quiet labelling is sent to described first decoder;
The described target signal source for the quiet broadcasting of needs, by the step of the audio decoder result zero setting of its correspondence, bag Include:
Judge whether the voice data to be decoded received meets prerequisite by described first decoder;
When described voice data to be decoded meets prerequisite, by described first decoder by described audio frequency to be decoded The audio decoder result zero setting that data are corresponding.
Alternatively, described voice data to be decoded meets prerequisite and includes:
Described voice data to be decoded has the preset quiet labelling of correspondence;Or
Corresponding preset quiet of described voice data to be decoded is labeled as preset value.
Alternatively, in the described target signal source for the quiet broadcasting of needs, by the audio decoder result zero setting of its correspondence Step before, described method also includes:
Create the second decoder;
The voice data to be decoded that described target signal source is corresponding is sent to described second decoder;
The described target signal source for the quiet broadcasting of needs is performed, by the audio frequency of its correspondence by described second decoder The step of decoded result zero setting.
On the other hand, the embodiment of the present invention provides a kind of apparatus for processing audio live based on multichannel, including:
Receiver module, for receiving the play instruction for multipath signal source;
Judge module, is used for judging that each road signal source is the need of quiet broadcasting;
Decoding process module, for the target signal source for the quiet broadcasting of needs, by the audio decoder result of its correspondence Zero setting;And
Output module, for according to described audio decoder result, exports the quiet of described target signal source.
Alternatively, described decoding process module, including:
Determine submodule, for the target signal source for the quiet broadcasting of needs, according to its corresponding voice data to be decoded Playing duration and form, determine the length of corresponding audio frequency decoded result;And
Element processes submodule, is used for creating storage organization, and by the element zero setting of described storage organization;Described storage knot The number of the comprised element of structure is consistent with the length of described audio decoder result.
Alternatively, described device also includes:
Labelling generation module, for described decoding process module for need quiet broadcasting target signal source, by it Before corresponding audio decoder result zero setting, for the target signal source of the quiet broadcasting of needs, generate corresponding preset quiet mark Note;
First creation module, for creating the first decoder;
First sending module, for sending, to described first decoder, the audio frequency number to be decoded that described target signal source is corresponding According to preset quiet labelling;
Described decoding process module, including:
Judge submodule, for judging whether the voice data to be decoded received meets preset by described first decoder Condition;And
First processes submodule, for when described voice data to be decoded meets prerequisite, solves by described first Code device is by audio decoder result zero setting corresponding for described voice data to be decoded.
Alternatively, described voice data to be decoded meets prerequisite and includes:
Described voice data to be decoded has the preset quiet labelling of correspondence;Or
Corresponding preset quiet of described voice data to be decoded is labeled as preset value.
Alternatively, described device also includes:
Second creation module, for described decoding process module for need quiet broadcasting target signal source, by it Before corresponding audio decoder result zero setting, create the second decoder;
Second sending module, for sending, to described second decoder, the audio frequency number to be decoded that described target signal source is corresponding According to;
Then perform the described target signal source for the quiet broadcasting of needs by described second decoder, by the sound of its correspondence The operation of decoded result zero setting frequently.
The audio-frequency processing method live based on multichannel of embodiment of the present invention offer and device, can be directly quiet by needs Audio decoder result zero setting corresponding to target signal source play, so, the Audio Processing mould of follow-up such as sound renderer Block can carry out audio frequency with the audio decoder result of the above-mentioned zero setting of direct basis and render, and then exports the quiet of above-mentioned target signal source Sound.Carry out the audio decoder computing of reality owing to the embodiment of the present invention can be not for target signal source, therefore target can be saved The terminal resources such as the CPU shared by audio decoder computing of signal source, internal memory, reduce the power consumption of intelligent terminal, and then improve intelligence The performance of energy terminal.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing In having technology to describe, the required accompanying drawing used is briefly described, it should be apparent that, the accompanying drawing in describing below is this Some bright embodiments, for those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to root Other accompanying drawing is obtained according to these accompanying drawings.
Fig. 1 shows the flow chart of steps of a kind of live based on the multichannel audio-frequency processing method embodiment one of the present invention;
Fig. 2 shows the examples of interfaces of the multi-channel video of a kind of intelligent television of the present invention;
Fig. 3 shows the flow chart of steps of a kind of live based on the multichannel audio-frequency processing method example 1 of the present invention;
Fig. 4 shows the flow chart of steps of a kind of live based on the multichannel audio-frequency processing method example 2 of the present invention;And
Fig. 5 shows the structured flowchart of a kind of live based on the multichannel apparatus for processing audio embodiment of the present invention.
Detailed description of the invention
For making the purpose of the embodiment of the present invention, technical scheme and advantage clearer, below in conjunction with the embodiment of the present invention In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is The a part of embodiment of the present invention rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art The every other embodiment obtained under not making creative work premise, broadly falls into the scope of protection of the invention.
Embodiment of the method one
With reference to Fig. 1, it is shown that the step stream of a kind of live based on the multichannel audio-frequency processing method embodiment one of the present invention Cheng Tu, specifically may include that
Step 101, receive for the play instruction of multipath signal source;
The audio-frequency processing method live based on multichannel that the embodiment of the present invention provides can be applicable to have video playback capability Intelligent terminal in, above-mentioned intelligent terminal is specifically including but not limited to: smart mobile phone, panel computer, E-book reader, MP3 (dynamic image expert's compression standard audio frequency aspect 3, Moving Picture Experts Group Audio Layer III) Player, MP4 (dynamic image expert's compression standard audio frequency aspect 4, Moving Picture Experts Group Audio Layer IV) player, pocket computer on knee, vehicle-mounted computer, desk computer, Set Top Box, intelligent television, wearable set Standby etc..
In actual applications, the audio-frequency processing method live based on multichannel that the embodiment of the present invention provides can be applicable to intelligence The APP (application program, Application) with video playback capability run in terminal, such as video player etc., this video Player can realize corresponding result of broadcast by the process of multipath signal source, and the embodiment of the present invention with video player is mainly Example illustrates, and other APP are cross-referenced.
In a kind of alternative embodiment of the present invention, intelligent television can provide a user with preset interface, so that user is led to Cross this preset interface and trigger above-mentioned play instruction;Further, intelligent television, after receiving above-mentioned play instruction, can be broadcast to video Put device and send above-mentioned play instruction.For example, referring to Fig. 2, it is shown that the interface of the multi-channel video of a kind of intelligent television of the present invention Example, it specifically may include that 1 focus video 201 and multiple non-focus video 202, and wherein, focus video 201 can position In the middle section of screen, and highlight box (such as red block) can be used to carry out labelling, non-focus video 202 may be located at screen Two side areas;Alternatively, the focus of remote controller can be given tacit consent to and is positioned at focus 201, and user can be by the directionkeys of remote controller Carry out focus to move, to carry out the switching of focus video.In actual applications, can with the video of normal play focus video 201, That is, the video pictures of focus video 201 both can be play, it is also possible to play the sound of focus video 201 according to default volume. It is alternatively possible to only play the video pictures of non-focus video 202, and non-focus video can be play by quiet mode The sound of 202, wherein, the video pictures of above-mentioned non-focus video 202 can help the switching that user carries out focus video, above-mentioned The quiet of non-focus video 202 can avoid non-focus video 202 for the interference of focus video 201.It is appreciated that above-mentioned figure The triggering mode of 2 correspondences is intended only as example, and actually the embodiment of the present invention is for the concrete triggering mode of above-mentioned play instruction It is not any limitation as.
Step 102, judge that each road signal source is the need of quiet broadcasting;
In a kind of alternative embodiment of the present invention, above-mentioned play instruction may include that the address letter of multipath signal source Breath and attribute information.Wherein address above mentioned information can be used for obtaining corresponding video data and/or voice data, for the ease of saying Bright, the voice data of target signal source is referred to as voice data to be decoded by the embodiment of the present invention.Above-mentioned attribute information can be used for marking Shi Ge road signal source is the need of quiet broadcasting, such as, in the multi-channel video that Fig. 2 is corresponding, 1 focus video need not quiet broadcasting Put, then corresponding attribute information can be 0, and multiple non-focus videos need quiet broadcasting, then the attribute information of correspondence can be 1.It is appreciated that those skilled in the art according to practical application request, can use the attribute information of correspondence neatly.The present invention Embodiment is for concrete attribute information and judges that each road signal source is not any limitation as the need of the concrete mode of quiet broadcasting.
Step 103, for need quiet broadcasting target signal source, by the audio decoder result zero setting of its correspondence;
In the embodiment of the present invention, target signal source can be not for and carry out the audio decoder computing of reality, but can be straight Connecing audio decoder result zero setting corresponding for target signal source, so, follow-up sound renderer can be put so that direct basis is above-mentioned The audio decoder result of zero carries out audio frequency and renders, and then exports the quiet of above-mentioned target signal source.Owing to the embodiment of the present invention can Carry out the audio decoder computing of reality being not for target signal source, therefore the audio decoder computing institute of target signal source can be saved The terminal resources such as the CPU that takies, internal memory, reduce the power consumption of intelligent terminal, and then improve the performance of intelligent terminal.
In a kind of alternative embodiment of the present invention, the described target signal source for the quiet broadcasting of needs, it is corresponding The step 103 of audio decoder result zero setting, specifically may include that
Step A1, for needing the target signal source of quiet broadcasting, during according to the broadcasting of its corresponding voice data to be decoded Length and form, determine the length of corresponding audio frequency decoded result;
Step A2, establishment storage organization, and by the element zero setting of described storage organization;The comprised element of described storage organization Number consistent with the length of described audio decoder result.
In actual applications, voice data to be decoded can derive from separator, and this separator can be to each road signal source Data separate, with obtain correspondence video data to be decoded and voice data to be decoded.Assume voice data to be decoded The data that playing duration is 0.1 second, it is assumed that the form of voice data to be decoded is: monophonic, 44.1KHz, 16bit, then walk The length of rapid A1 obtained audio decoder result can be expressed as: 0.1 × 44100 × (16/2).It is appreciated that above-mentioned acquisition sound Frequently the length of the length of decoded result is intended only as example, and the actually embodiment of the present invention obtains audio decoder knot for step A1 The detailed process of the length of fruit is not any limitation as.
In a kind of alternative embodiment of the present invention, above-mentioned storage organization specifically may include that array, queue, chained list etc.. When at this, a kind of storage organization of offer is array, by the example of the element zero setting of array.
For int i=0;i++;i<sizeof(outpuBuffer){
OutputBuffer [i]=0;
}
Wherein, sizeof (outpuBuffer) represents the length of audio decoder result, and outputBuffer [i] represents number The i-th element of group, the final element of this array can be expressed as [0,0,0 ... 0,0].
It is appreciated that those skilled in the art can be corresponding by target signal source neatly according to practical application request Audio decoder result zero setting, the embodiment of the present invention is for the detailed process by audio decoder result zero setting corresponding for target signal source It is not any limitation as.
Step 104, according to described audio decoder result, export the sound of described target signal source.
In actual applications, step 103 can be performed by audio decoder, then this audio decoder can be by above-mentioned audio frequency Decoded result exports to sound renderer, so that the audio decoder result of the above-mentioned zero setting of sound renderer direct basis carries out audio frequency Render, due to after above-mentioned audio decoder result is delivered to sound card, sound card will be left intact, therefore can by output above-mentioned Target signal source quiet.
To sum up, carry out the audio decoder computing of reality owing to the embodiment of the present invention can be not for target signal source, therefore can With terminal resources such as the CPU shared by the audio decoder computing of saving target signal source, internal memories, reduce the power consumption of intelligent terminal, And then improve the performance of intelligent terminal.
Embodiment of the method two
Embodiment of the method two is the alternative embodiment of embodiment of the method one, and it, on the basis of embodiment of the method one, enters one Step includes following technical scheme.
In the described target signal source for the quiet broadcasting of needs, by the step of the audio decoder result zero setting of its correspondence Before 103, the method for embodiment of the method two can also include:
For the target signal source of the quiet broadcasting of needs, generate corresponding preset quiet labelling;
Create the first decoder;
Voice data to be decoded corresponding to described target signal source and preset quiet labelling is sent to described first decoder;
The then described target signal source for the quiet broadcasting of needs, by the step of the audio decoder result zero setting of its correspondence 103, specifically may include that
Step B1, by described first decoder judge receive voice data to be decoded whether meet prerequisite;
Step B2, when described voice data to be decoded meets prerequisite, treated described by described first decoder The audio decoder result zero setting that decoding audio data is corresponding.
In the embodiment of the present invention, video player or other APP can for needing the target signal source of quiet broadcasting, Generate corresponding preset quiet labelling (bMute), and send this preset quiet labelling to the first decoder, to notify the first decoding This broadcasting of device will be quiet.
First decoder can be common decoder, and it can judge whether to need quiet broadcasting by decision logic By judged result, the process of the target signal source put, specifically, is determining that described voice data to be decoded meets prerequisite Time, can carry out needing the process of the target signal source of quiet broadcasting, with by audio frequency solution corresponding for described voice data to be decoded Code result zero setting.
In a kind of alternative embodiment of the present invention, described voice data to be decoded meets prerequisite and specifically can wrap Include: described voice data to be decoded has the preset quiet labelling of correspondence;That is, receive audio frequency to be decoded at the first decoder During preset quiet labelling corresponding to data, it is believed that voice data to be decoded meets prerequisite, then can not carry out reality Audio decoder computing, also will audio decoder result zero setting corresponding to described voice data to be decoded;And do not receiving During preset quiet labelling corresponding to voice data to be decoded, it is believed that voice data to be decoded does not meets prerequisite, therefore can To carry out the audio decoder computing of reality.
Or, in the another kind of alternative embodiment of the present invention, it is concrete that described voice data to be decoded meets prerequisite May include that corresponding preset quiet of described voice data to be decoded is labeled as preset value.Receive at the first decoder and wait to solve During code preset quiet labelling bMute corresponding to voice data, the value of this preset quiet labelling bMute can be read, if it find that The value of bMute is preset value (such as ture), then can not carry out the audio decoder computing of reality, also will described audio frequency to be decoded The audio decoder result zero setting that data are corresponding;If it find that the value of bMute is non-preset value (such as false), then can carry out reality The audio decoder computing on border.
With reference to Fig. 3, it is shown that the steps flow chart of a kind of live based on the multichannel audio-frequency processing method example 1 of the present invention Figure, specifically may include steps of:
Step 301, receive for the play instruction of multipath signal source;
Step 302, judge that corresponding preset quiet labelling the need of quiet broadcasting, is the most then put by each road signal source For ture, otherwise corresponding preset quiet labelling is set to false;
Step 303, create separator, and utilize separator that each road signal source is separated, with obtain correspondence wait solve Code video data and voice data to be decoded;
Step 304, create the first decoder, and initialize this first decoder;
Step 305, send voice data to be decoded corresponding to each road signal source and form thereof to this first decoder (such as code Rate) and preset quiet labelling;
The embodiment of the present invention for step 303 and step 304 or step 304 and step 305 execution sequence the most in addition Limit, the two can successively, parallel or after first carry out.
Step 306, judged preset quiet labelling corresponding to voice data to be decoded that receive by described first decoder Whether being preset value, if then performing step 307, otherwise performing step 308;
Step 307, by this first decoder by audio decoder result zero setting corresponding for described voice data to be decoded;
Step 308, treat decoding audio data carry out reality audio decoder computing;
Step 309, obtain the audio decoder result of the first decoder, by audio decoder result output to sound renderer with For rendering and then export the quiet of correspondence.
It should be noted that in the case of performing step 308, the audio decoder result of the first decoder can be obtained, By audio decoder result output to sound renderer for the non-mute rendering and then exporting correspondence.
To sum up, the embodiment of the present invention can increase decision logic, to be patrolled by this judgement in existing first decoder Collect and judge whether to need the process of the target signal source of quiet broadcasting, specifically, specifically, determined by judged result When described voice data to be decoded meets prerequisite, can carry out needing the process of the target signal source of quiet broadcasting, logical Cross judged result to determine when described voice data to be decoded does not meets prerequisite, decoding audio data can be treated and carry out reality Audio decoder computing, owing to the embodiment of the present invention can realize the silence processing of target signal source and non-by the first decoder The non-mute of target signal source processes, and therefore has the advantage saving decoder resources.
Embodiment of the method three
Embodiment of the method three is the alternative embodiment of embodiment of the method one, and it, on the basis of embodiment of the method three, enters one Step includes following technical scheme.
In the described target signal source for the quiet broadcasting of needs, by the step of the audio decoder result zero setting of its correspondence Before 103, the method for embodiment of the method two can also include:
Step D1, create the second decoder;
Step D2, send voice data to be decoded corresponding to described target signal source to described second decoder;
Step D3, performed by described second decoder described for needing the target signal source of quiet broadcasting, it is right The step of the audio decoder result zero setting answered.
Regardless of the form of the corresponding voice data to be decoded of target signal source, the embodiment of the present invention all can create one It is specifically designed to the second decoder carrying out needing the process of the target signal source of quiet broadcasting.So, this second decoder can With in the case of not judging, obtain the audio decoder result of (all 0) that is left intact.
With reference to Fig. 4, it is shown that the steps flow chart of a kind of live based on the multichannel audio-frequency processing method example 2 of the present invention Figure, specifically may include steps of:
Step 401, receive for the play instruction of multipath signal source;
Step 402, judge that each road signal source the need of quiet broadcasting, the most then performs step 403 and step 404;
Step 403, create separator, and utilize separator that each road signal source is separated, with obtain correspondence wait solve Code video data and voice data to be decoded;
Step 404, create the second decoder, and initialize this second decoder;
Step 405, send voice data to be decoded corresponding to each road signal source and form thereof to this second decoder (such as code Rate);
The embodiment of the present invention for step 403 and step 404 or step 404 and step 405 execution sequence the most in addition Limit, the two can successively, parallel or after first carry out.
Step 406, the described target signal source for the quiet broadcasting of needs, by described second decoder by its correspondence Audio decoder result zero setting;
Step 407, obtain the audio decoder result of the second decoder, by audio decoder result output to sound renderer with For rendering and then export the quiet of correspondence.
It should be noted that when step 402 determines that each road signal source need not quiet broadcasting, the first decoding can be created Device, owing to this first decoder determines, by abovementioned steps 306, the preset quiet labelling that the voice data to be decoded of reception is corresponding It is not preset value, therefore can perform to treat the step 308 of the audio decoder computing that decoding audio data carries out reality, this kind of situation Under, the audio decoder result of the first decoder can be obtained, by the output of audio decoder result to sound renderer for rendering, entering And export the non-mute of correspondence.
To sum up, the embodiment of the present invention can create the special process for carrying out needing the target signal source of quiet broadcasting The second decoder, the second decoder this described perform described for needing the target signal source of quiet broadcasting, it is corresponding The step of audio decoder result zero setting, therefore the embodiment of the present invention has and realizes simple advantage.
It should be noted that for embodiment of the method, in order to be briefly described, therefore it is all expressed as a series of action group Closing, but those skilled in the art should know, the embodiment of the present invention is not limited by described sequence of movement, because depending on According to the embodiment of the present invention, some step can use other orders or carry out simultaneously.Secondly, those skilled in the art also should Knowing, embodiment described in this description belongs to preferred embodiment, and the involved action not necessarily present invention implements Necessary to example.
Device embodiment
With reference to Fig. 3, it is shown that the structured flowchart of a kind of live based on the multichannel apparatus for processing audio embodiment of the present invention, Specifically may include that
Receiver module 501, for receiving the play instruction for multipath signal source;
Judge module 502, is used for judging that each road signal source is the need of quiet broadcasting;
Decoding process module 503, for the target signal source for the quiet broadcasting of needs, ties the audio decoder of its correspondence Really zero setting;And
Output module 504, for according to described audio decoder result, exports the quiet of described target signal source.
In a kind of alternative embodiment of the present invention, described decoding process module 503, specifically may include that
Determine submodule, for the target signal source for the quiet broadcasting of needs, according to its corresponding voice data to be decoded Playing duration and form, determine the length of corresponding audio frequency decoded result;And
Element processes submodule, is used for creating storage organization, and by the element zero setting of described storage organization;Described storage knot The number of the comprised element of structure is consistent with the length of described audio decoder result.
In the another kind of alternative embodiment of the present invention, described device can also include:
Labelling generation module, is used at described decoding process module 503 for the target signal source of the quiet broadcasting of needs, incites somebody to action Before the audio decoder result zero setting of its correspondence, for the target signal source of the quiet broadcasting of needs, generate the preset quiet of correspondence Labelling;
First creation module, for creating the first decoder;
First sending module, for sending, to described first decoder, the audio frequency number to be decoded that described target signal source is corresponding According to preset quiet labelling;
Described decoding process module 503, specifically may include that
Judge submodule, for judging whether the voice data to be decoded received meets preset by described first decoder Condition;And
First processes submodule, for when described voice data to be decoded meets prerequisite, solves by described first Code device is by audio decoder result zero setting corresponding for described voice data to be decoded.
In another alternative embodiment of the present invention, described voice data to be decoded meets prerequisite and specifically can wrap Include:
Described voice data to be decoded has the preset quiet labelling of correspondence;Or
Corresponding preset quiet of described voice data to be decoded is labeled as preset value.
In another alternative embodiment of the present invention, described device can also include:
Second creation module, is used at described decoding process module 503 for the target signal source of the quiet broadcasting of needs, incites somebody to action Before the audio decoder result zero setting of its correspondence, create the second decoder;
Second sending module, for sending, to described second decoder, the audio frequency number to be decoded that described target signal source is corresponding According to;
The most described decoding process module 503 can perform described for needing quiet broadcasting by described second decoder Target signal source, by the operation of the audio decoder result zero setting of its correspondence.
For device embodiment, due to itself and embodiment of the method basic simlarity, so describe is fairly simple, relevant Part sees the part of embodiment of the method and illustrates.
Device embodiment described above is only schematically, and the wherein said unit illustrated as separating component can To be or to may not be physically separate, the parts shown as unit can be or may not be physics list Unit, i.e. may be located at a place, or can also be distributed on multiple NE.Can be selected it according to the actual needs In some or all of module realize the purpose of the present embodiment scheme.Those of ordinary skill in the art are not paying creativeness Work in the case of, be i.e. appreciated that and implement.
Through the above description of the embodiments, those skilled in the art it can be understood that to each embodiment can The mode adding required general hardware platform by software realizes, naturally it is also possible to pass through hardware.Based on such understanding, on State the part that prior art contributes by technical scheme the most in other words to embody with the form of software product, should Computer software product can store in a computer-readable storage medium, such as ROM/RAM, magnetic disc, CD etc., including some fingers Make with so that a computer equipment (can be personal computer, server, or the network equipment etc.) performs each and implements The method described in some part of example or embodiment.
Last it is noted that above example is only in order to illustrate technical scheme, it is not intended to limit;Although With reference to previous embodiment, the present invention is described in detail, it will be understood by those within the art that: it still may be used So that the technical scheme described in foregoing embodiments to be modified, or wherein portion of techniques feature is carried out equivalent; And these amendment or replace, do not make appropriate technical solution essence depart from various embodiments of the present invention technical scheme spirit and Scope.

Claims (10)

1. one kind based on the live audio-frequency processing method of multichannel, it is characterised in that including:
Receive the play instruction for multipath signal source;
Judge that each road signal source is the need of quiet broadcasting;
For the target signal source of the quiet broadcasting of needs, by the audio decoder result zero setting of its correspondence;
According to described audio decoder result, export the quiet of described target signal source.
Method the most according to claim 1, it is characterised in that the described target signal source for the quiet broadcasting of needs, will The step of the audio decoder result zero setting of its correspondence, including:
For the target signal source of the quiet broadcasting of needs, according to playing duration and the form of its corresponding voice data to be decoded, really The length of fixed corresponding audio frequency decoded result;
Create storage organization, and by the element zero setting of described storage organization;The number of the comprised element of described storage organization and institute The length stating audio decoder result is consistent.
Method the most according to claim 1 and 2, it is characterised in that described for the echo signal needing quiet broadcasting Source, before the step of the audio decoder result zero setting of its correspondence, described method also includes:
For the target signal source of the quiet broadcasting of needs, generate corresponding preset quiet labelling;
Create the first decoder;
Voice data to be decoded corresponding to described target signal source and preset quiet labelling is sent to described first decoder;
Described for needing the target signal source of quiet broadcasting, by the step of the audio decoder result zero setting of its correspondence, including:
Judge whether the voice data to be decoded received meets prerequisite by described first decoder;
When described voice data to be decoded meets prerequisite, by described first decoder by described voice data to be decoded Corresponding audio decoder result zero setting.
Method the most according to claim 3, it is characterised in that described voice data to be decoded meets prerequisite and includes:
Described voice data to be decoded has the preset quiet labelling of correspondence;Or
Corresponding preset quiet of described voice data to be decoded is labeled as preset value.
Method the most according to claim 1 and 2, it is characterised in that described for the echo signal needing quiet broadcasting Source, before the step of the audio decoder result zero setting of its correspondence, described method also includes:
Create the second decoder;
The voice data to be decoded that described target signal source is corresponding is sent to described second decoder;
The described target signal source for the quiet broadcasting of needs is performed, by the audio decoder of its correspondence by described second decoder The step of result zero setting.
6. one kind based on the live apparatus for processing audio of multichannel, it is characterised in that including:
Receiver module, for receiving the play instruction for multipath signal source;
Judge module, is used for judging that each road signal source is the need of quiet broadcasting;
Decoding process module, for the target signal source for the quiet broadcasting of needs, by the audio decoder result zero setting of its correspondence; And
Output module, for according to described audio decoder result, exports the quiet of described target signal source.
Device the most according to claim 6, it is characterised in that described decoding process module, including:
Determine submodule, for the target signal source for the quiet broadcasting of needs, according to broadcasting of its corresponding voice data to be decoded Put duration and form, determine the length of corresponding audio frequency decoded result;And
Element processes submodule, is used for creating storage organization, and by the element zero setting of described storage organization;Described storage organization institute The number comprising element is consistent with the length of described audio decoder result.
8. according to the device described in claim 6 or 7, it is characterised in that described device also includes:
Labelling generation module, at described decoding process module for needing the target signal source of quiet broadcasting, it is corresponding Audio decoder result zero setting before, for needing the target signal source of quiet broadcasting, generate corresponding preset quiet labelling;
First creation module, for creating the first decoder;
First sending module, for described first decoder send voice data to be decoded corresponding to described target signal source and Preset quiet labelling;
Described decoding process module, including:
Judge submodule, for judging whether the voice data to be decoded received meets preset bar by described first decoder Part;And
First processes submodule, for when described voice data to be decoded meets prerequisite, by described first decoder By audio decoder result zero setting corresponding for described voice data to be decoded.
Device the most according to claim 8, it is characterised in that described voice data to be decoded meets prerequisite and includes:
Described voice data to be decoded has the preset quiet labelling of correspondence;Or
Corresponding preset quiet of described voice data to be decoded is labeled as preset value.
10. according to the device described in claim 6 or 7, it is characterised in that described device also includes:
Second creation module, at described decoding process module for needing the target signal source of quiet broadcasting, it is corresponding Audio decoder result zero setting before, create the second decoder;
Second sending module, for sending, to described second decoder, the voice data to be decoded that described target signal source is corresponding;
The most described decoding process module performs the described target signal source for the quiet broadcasting of needs by described second decoder, Operation by the audio decoder result zero setting of its correspondence.
CN201610425402.5A 2016-06-15 2016-06-15 Audio processing method and device based on multi-way live broadcast Pending CN106060627A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610425402.5A CN106060627A (en) 2016-06-15 2016-06-15 Audio processing method and device based on multi-way live broadcast

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610425402.5A CN106060627A (en) 2016-06-15 2016-06-15 Audio processing method and device based on multi-way live broadcast

Publications (1)

Publication Number Publication Date
CN106060627A true CN106060627A (en) 2016-10-26

Family

ID=57167556

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610425402.5A Pending CN106060627A (en) 2016-06-15 2016-06-15 Audio processing method and device based on multi-way live broadcast

Country Status (1)

Country Link
CN (1) CN106060627A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106791525A (en) * 2016-12-02 2017-05-31 福建捷联电子有限公司 The display of automatic mute
CN107704231A (en) * 2017-09-25 2018-02-16 青岛海信电器股份有限公司 Multi-audio-frequency selects player method and device
CN109257646A (en) * 2018-10-15 2019-01-22 Oppo广东移动通信有限公司 Method for processing video frequency, device, electronic equipment and computer-readable medium
CN109996099A (en) * 2019-04-16 2019-07-09 百度在线网络技术(北京)有限公司 Audio focus control method, system and the onboard system of onboard system
CN110113307A (en) * 2019-04-01 2019-08-09 视联动力信息技术股份有限公司 A kind of method and apparatus of live streaming
CN112887479A (en) * 2021-01-28 2021-06-01 维沃移动通信有限公司 Video playing method and device, electronic equipment and storage medium
CN117558283A (en) * 2024-01-12 2024-02-13 杭州国芯科技股份有限公司 Multi-channel multi-standard audio decoding architecture

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6119239A (en) * 1997-08-27 2000-09-12 International Business Machines Corporation Information processing system with power saving audio state
CN101615413A (en) * 2009-07-27 2009-12-30 上海华平信息技术股份有限公司 Multichannel audio/video Play System and method
CN101848280A (en) * 2009-03-25 2010-09-29 深圳富泰宏精密工业有限公司 System and method for saving power for silently playing music
CN101917568A (en) * 2009-12-17 2010-12-15 新奥特(北京)视频技术有限公司 Streaming media technology-based network video player and playing system
CN102223569A (en) * 2007-11-28 2011-10-19 华为终端有限公司 Multi-path video processing method
EP2472519A1 (en) * 2011-01-04 2012-07-04 Samsung Electronics Co., Ltd. Multi-video rendering for enhancing user interface usability and user experience
CN103680551A (en) * 2012-09-21 2014-03-26 深圳市快播科技有限公司 Player and method thereof for simultaneously playing multiple videos
CN105165017A (en) * 2013-02-25 2015-12-16 萨万特系统有限责任公司 Video tiling

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6119239A (en) * 1997-08-27 2000-09-12 International Business Machines Corporation Information processing system with power saving audio state
CN102223569A (en) * 2007-11-28 2011-10-19 华为终端有限公司 Multi-path video processing method
CN101848280A (en) * 2009-03-25 2010-09-29 深圳富泰宏精密工业有限公司 System and method for saving power for silently playing music
CN101615413A (en) * 2009-07-27 2009-12-30 上海华平信息技术股份有限公司 Multichannel audio/video Play System and method
CN101917568A (en) * 2009-12-17 2010-12-15 新奥特(北京)视频技术有限公司 Streaming media technology-based network video player and playing system
EP2472519A1 (en) * 2011-01-04 2012-07-04 Samsung Electronics Co., Ltd. Multi-video rendering for enhancing user interface usability and user experience
CN103680551A (en) * 2012-09-21 2014-03-26 深圳市快播科技有限公司 Player and method thereof for simultaneously playing multiple videos
CN105165017A (en) * 2013-02-25 2015-12-16 萨万特系统有限责任公司 Video tiling

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
王伟: "数字视音频复用技术", 《电视工程》 *
王琳: "基于Android平台音频播放系统的设计与实现", 《中国优秀硕士学位论文全文数据库(信息科技辑)》 *

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106791525A (en) * 2016-12-02 2017-05-31 福建捷联电子有限公司 The display of automatic mute
CN106791525B (en) * 2016-12-02 2019-09-20 福建捷联电子有限公司 The display of automatic mute
CN107704231A (en) * 2017-09-25 2018-02-16 青岛海信电器股份有限公司 Multi-audio-frequency selects player method and device
US11336953B2 (en) 2018-10-15 2022-05-17 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Video processing method, electronic device, and computer-readable medium
CN109257646A (en) * 2018-10-15 2019-01-22 Oppo广东移动通信有限公司 Method for processing video frequency, device, electronic equipment and computer-readable medium
CN109257646B (en) * 2018-10-15 2020-09-22 Oppo广东移动通信有限公司 Video processing method and device, electronic equipment and computer readable medium
CN110113307A (en) * 2019-04-01 2019-08-09 视联动力信息技术股份有限公司 A kind of method and apparatus of live streaming
CN109996099A (en) * 2019-04-16 2019-07-09 百度在线网络技术(北京)有限公司 Audio focus control method, system and the onboard system of onboard system
CN109996099B (en) * 2019-04-16 2022-11-01 阿波罗智联(北京)科技有限公司 Audio focus control method and system of vehicle-mounted system and vehicle-mounted system
CN112887479A (en) * 2021-01-28 2021-06-01 维沃移动通信有限公司 Video playing method and device, electronic equipment and storage medium
CN112887479B (en) * 2021-01-28 2022-07-22 维沃移动通信有限公司 Video playing method and device, electronic equipment and storage medium
CN117558283A (en) * 2024-01-12 2024-02-13 杭州国芯科技股份有限公司 Multi-channel multi-standard audio decoding architecture
CN117558283B (en) * 2024-01-12 2024-03-22 杭州国芯科技股份有限公司 Multi-channel multi-standard audio decoding system

Similar Documents

Publication Publication Date Title
CN106060627A (en) Audio processing method and device based on multi-way live broadcast
CN101035279B (en) Method for using the information set in the video resource
CN109257611A (en) A kind of video broadcasting method, device, terminal device and server
CN1997153B (en) A method and device for computer multi-video playing
CN104683852B (en) The method and apparatus for handling broadcast message
CN101588488A (en) Multiple-position streaming media transmitting method as well as multiple-position streaming media broadcasting method and system
CN103680551A (en) Player and method thereof for simultaneously playing multiple videos
CN110691281B (en) Video playing processing method, terminal device, server and storage medium
CN104185040A (en) Application synchronization method, application server and terminal
CN106331878A (en) Video clip and electronic book chip switching display method and apparatus
CN105898538A (en) Play method and device and mobile terminal equipment based on Android platform
CN105308976A (en) Presenting advertisements during media content seek
CN103327021A (en) Method, devices and system of multi-device interaction
CN107770624A (en) It is a kind of it is live during multimedia file player method, device and storage medium
CN113015005A (en) Video clipping method, device and equipment and computer readable storage medium
CN112492347A (en) Method for processing information flow and displaying bullet screen information and information flow processing system
KR20170063860A (en) Promotion information processing method, device, and apparatus, and non-volatile computer storage medium
CN110166795A (en) A kind of video interception method and device
CN102196268B (en) Method, device and system for processing multimedia data
CN101945263A (en) Method for using information sets in video resources
CN103929640A (en) Techniques For Managing Video Streaming
CN105979354A (en) Channel switching method and device
CN103841451A (en) Multimedia playing method, device and terminal
CN107580264A (en) Multimedia resource play handling method and device
CN111935495A (en) AR technology-based live video commodity display method and system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20161026

WD01 Invention patent application deemed withdrawn after publication