CN105609122A

CN105609122A - Control method and device of terminal device

Info

Publication number: CN105609122A
Application number: CN201510994014.4A
Authority: CN
Inventors: 刘才权; 唐杰; 陈聪; 张丙林
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2015-12-25
Filing date: 2015-12-25
Publication date: 2016-05-25
Also published as: WO2017107428A1

Abstract

The present invention provides a control method and device of a terminal device. According to the embodiment of the invention, the implementation of the synchronous communication between the audio module corresponding to each audio source and the audio modules corresponding to other audio sources to determine whether the audio source can carry out audio data sending is not needed, the starting playing command of the audio data and the audio source priority information to which the audio data belongs are added to the audio data to be sent to an Internet application, the Internet application carries out volume management uniformly, with different volumes, the audio data of different audio sources are played at the same time, and thus the problem of system resource waste caused by the synchronous communication between audio modules in the prior art can be avoided.

Description

The control method of terminal device and device

[technical field]

The present invention relates to the communication technology, relate in particular to control method and the device of terminal device.

[background technology]

Along with the development of the communication technology, increasing function that terminal device is integrated, thus make terminalMore and more corresponding application (Application, APP) in the systemic-function list of equipment, are comprised. HaveThe application of installing on a little terminal devices, is called interconnecting application in the present invention, need to be by connectedA corresponding fit applications is installed on another terminal device could normally be used, otherwise without any makingBy value, particularly for some car machine interconnecting applications.

Under normal circumstances, in order to make interconnecting application can obtain and control fit applications place terminal deviceVoice data, fit applications can send to interconnecting application the broadcasting control of voice data and this voice dataInformation processed, according to obtained Play Control information, carries out Play Control to voice data by interconnecting applicationProcessing example as, start play, suspend, recover play etc.

In some cases, fit applications need to send to interconnecting application the voice data of multiple sources of sound, exampleAs, the TTS audio frequency of the song voice data of the music function of fit applications, the navigation feature of fit applicationsData (TextToSpeech, TTS) etc., before sending voice data, each source of sound is correspondingAudio-frequency module need to carry out synchronous communication with the corresponding audio-frequency module of other sources of sound, whether to determine selfCan carry out voice data transmission. Only have and determine the audio frequency that self can carry out the source of sound of audio data transmissionModule, just can send to interconnecting application by the voice data of this source of sound by fit applications. At a soundIn the process of transmitting of the voice data in source, the corresponding audio-frequency module of this source of sound also need Real-Time Monitoring otherThe voice data of the corresponding audio-frequency module of source of sound sends situation, if the corresponding audio-frequency module of other sources of soundVoice data transmission situation change, need with the corresponding audio-frequency module of other sources of sound carry out withStep communication, sends to determine self whether to suspend voice data transmission or recover voice data.

But, because the corresponding audio-frequency module of each source of sound need to be with the corresponding audio frequency mould of other sources of soundPiece carries out synchronous communication, to determine whether self can carry out voice data transmission, thereby has caused terminalThe waste of the system resource of equipment.

[summary of the invention]

Many aspects of the present invention provide control method and the device of terminal device, in order to avoid terminal deviceThe waste of system resource.

An aspect of of the present present invention, provides a kind of control method of terminal device, comprising:

Obtain the original audio number of the second terminal device that interconnecting application place first terminal equipment connectsAccording to;

By the sound of source of sound under the beginning play instruction of described original audio data and described original audio dataSource precedence information adds in described original audio data, to obtain voice data to be played;

By described voice data to be played, send to described interconnecting application.

Aspect as above and arbitrary possible implementation, further provide a kind of implementation, instituteThe original audio data of stating the second terminal device, comprising:

The voice data of the fit applications on corresponding described the second terminal device of described interconnecting application; OrPerson

The voice data of other application on described the second terminal device except described fit applications.

Aspect as above and arbitrary possible implementation, further provide a kind of implementation, instituteState the source of sound of source of sound under the beginning play instruction of described original audio data and described original audio dataPrecedence information adds in described original audio data, before obtaining voice data to be played, and also bagDraw together:

Obtain the audio frequency associative operation event data that user operates described the second terminal device; And according to instituteState audio frequency associative operation event data, obtain the beginning play instruction of described original audio data; Or

Obtain the fit applications or described second on corresponding described the second terminal device of described interconnecting applicationThe described original audio data that other application on terminal device except described fit applications triggerStart play instruction.

Aspect as above and arbitrary possible implementation, further provide a kind of implementation, instituteState the source of sound of source of sound under the beginning play instruction of described original audio data and described original audio dataPrecedence information adds in described original audio data, to obtain voice data to be played, comprising:

Described beginning play instruction and described source of sound precedence information are added in blank frame, to generate soundFrequently control frame;

Described audio frequency control frame is inserted in described original audio data, to obtain described audio frequency to be playedData.

Aspect as above and arbitrary possible implementation, further provide a kind of implementation,

Described first terminal equipment is vehicle-mounted terminal equipment;

Described the second terminal device is subscriber terminal equipment.

Another aspect of the present invention, provides the control method of another kind of terminal device, comprising:

Receive the fit applications institute on corresponding the second terminal device of interconnecting application on first terminal equipmentThe voice data to be played of described the second terminal device sending;

Described voice data to be played is carried out to dissection process, to obtain original audio data, described originalThe source of sound precedence information of source of sound under the beginning play instruction of voice data and described original audio data;

If the source of sound under described original audio data is not identical with the source of sound of the voice data of current broadcasting,According to source of sound precedence information and the institute of source of sound under described beginning play instruction, described original audio dataState the source of sound precedence information of current broadcasting source of sound, the broadcasting of the affiliated source of sound of described original audio data is setThe broadcast sound volume of volume and current broadcasting source of sound;

With the broadcast sound volume of source of sound under described original audio data and the broadcasting sound of described current broadcasting source of soundAmount, to the voice data of described original audio data and described current broadcasting source of sound, carries out audio mixing broadcasting placeReason.

Aspect as above and arbitrary possible implementation, further provide a kind of implementation, instituteState described voice data to be played is carried out to dissection process, to obtain original audio data, described original soundThe source of sound precedence information of source of sound under the beginning play instruction of audio data and described original audio data, bagDraw together:

Described voice data to be played is carried out to dissection process, to obtain described original audio data, audio frequencyDescribed source of sound precedence information in described beginning play instruction and described audio frequency control frame in control frame.

Aspect as above and arbitrary possible implementation, further provide a kind of implementation, instituteThe method of stating also comprises:

If finish described original audio data, and still receive the audio frequency of described current broadcasting source of soundData, with the broadcast sound volume before described setting, continue to play the voice data of described current broadcasting source of sound;Or

If finish the voice data of described current broadcasting source of sound, and still receive described original audioData, with the broadcast sound volume before described setting, continue to play described original audio data.

Described first terminal equipment is vehicle-mounted terminal equipment;

Described the second terminal device is subscriber terminal equipment.

Receive the fit applications institute on corresponding the second terminal device of interconnecting application on first terminal equipmentThe voice data to be played of at least two sources of sound of described the second terminal device sending;

Voice data to be played to each source of sound in the voice data to be played of described at least two sources of sound entersRow dissection process, to obtain the original sound of the original audio data of described each source of sound, described each source of soundThe beginning play instruction of audio data and the source of sound precedence information of described each source of sound;

According to described beginning play instruction and described source of sound precedence information, broadcasting of described each source of sound is setPlayback amount;

With the broadcast sound volume of described each source of sound, to the original audio data of described each source of sound, mixSound playback process.

Aspect as above and arbitrary possible implementation, further provide a kind of implementation, instituteState the voice data to be played of each source of sound in the voice data to be played of described at least two sources of sound is carried outDissection process, to obtain the original audio data of described each source of sound, the original audio of described each source of soundThe beginning play instruction of data and the source of sound precedence information of described each source of sound, comprising:

Voice data to be played to described each source of sound carries out dissection process, to obtain described each source of soundOriginal audio data, audio frequency control frame in described beginning play instruction and described audio frequency control frame inDescribed source of sound precedence information.

Described first terminal equipment is vehicle-mounted terminal equipment;

Described the second terminal device is subscriber terminal equipment.

Another aspect of the present invention, provides a kind of control device of terminal device, comprising:

Acquiring unit, the second terminal device connecting for obtaining interconnecting application place first terminal equipmentOriginal audio data;

Point frame unit, for by the beginning play instruction of described original audio data and described original audio numberAdd in described original audio data according to the source of sound precedence information of affiliated source of sound, to obtain sound to be playedAudio data;

Transmitting element, for by described voice data to be played, sends to described interconnecting application.

Aspect as above and arbitrary possible implementation, further provide a kind of implementation, instituteState a point frame unit, also for

Aspect as above and arbitrary possible implementation, further provide a kind of implementation, instituteState a point frame unit, specifically for

Described beginning play instruction and described source of sound precedence information are added in blank frame, to generate soundFrequently control frame; And

Described first terminal equipment is vehicle-mounted terminal equipment;

Described the second terminal device is subscriber terminal equipment.

Another aspect of the present invention, provides the control device of another kind of terminal device, comprising:

Receiving element, for receiving corresponding the second terminal device of interconnecting application on first terminal equipmentOn the voice data to be played of described the second terminal device of sending of fit applications;

Resolution unit, for described voice data to be played is carried out to dissection process, to obtain original audioThe sound of source of sound under the beginning play instruction of data, described original audio data and described original audio dataSource precedence information;

Setting unit, if for the voice data of the source of sound under described original audio data and current broadcastingSource of sound not identical, according to the source of sound of source of sound under described beginning play instruction, described original audio dataThe source of sound precedence information of precedence information and described current broadcasting source of sound, arranges described original audio dataThe affiliated broadcast sound volume of source of sound and the broadcast sound volume of current broadcasting source of sound;

Broadcast unit, for the broadcast sound volume with source of sound under described original audio data and described current broadcastingThe broadcast sound volume in playback source, to the voice data of described original audio data and described current broadcasting source of sound,Carry out audio mixing playback process.

Aspect as above and arbitrary possible implementation, further provide a kind of implementation, instituteState resolution unit, specifically for

Aspect as above and arbitrary possible implementation, further provide a kind of implementation, instituteState broadcast unit, also for

Described first terminal equipment is vehicle-mounted terminal equipment;

Described the second terminal device is subscriber terminal equipment.

Receiving element, for receiving corresponding the second terminal device of interconnecting application on first terminal equipmentOn the audio frequency number to be played of at least two sources of sound of described the second terminal device of sending of fit applicationsAccording to;

Resolution unit, for treating of the each source of sound of voice data to be played to described at least two sources of soundPlaying audio-fequency data carries out dissection process, to obtain the original audio data, described every of described each source of soundThe beginning play instruction of the original audio data of individual source of sound and the source of sound precedence information of described each source of sound;

Setting unit, for according to described beginning play instruction and described source of sound precedence information, arranges instituteState the broadcast sound volume of each source of sound;

Broadcast unit, for the broadcast sound volume with described each source of sound, to the original sound of described each source of soundAudio data, carries out audio mixing playback process.

Described first terminal equipment is vehicle-mounted terminal equipment;

Described the second terminal device is subscriber terminal equipment.

From described technical scheme, on the one hand, the embodiment of the present invention is by obtaining interconnecting application placeThe original audio data of the second terminal device that one terminal device connects, and then by described original audio numberAccording to beginning play instruction and described original audio data under the source of sound precedence information of source of sound add institute toState in original audio data, to obtain voice data to be played, make it possible to described audio frequency number to be playedAccording to, send to described interconnecting application, due to without the corresponding audio-frequency module of each source of sound again with other soundsThe corresponding audio-frequency module in source carries out synchronous communication, to determine whether self can carry out voice data transmission,But the source of sound precedence information of source of sound under the beginning play instruction of voice data and this voice data is addedBe added in voice data and send to together interconnecting application, carry out volume setting by interconnecting application unification, with notWith volume, play the voice data of different sources of sound simultaneously, therefore, can avoid in prior art due toThe problem of the waste of the synchronous communication between audio-frequency module and the system resource that causes.

From described technical scheme, on the other hand, the embodiment of the present invention is by receiving first terminal equipmentOn corresponding the second terminal device of interconnecting application on described the second terminal of sending of fit applications establishStandby voice data to be played, and then described voice data to be played is carried out to dissection process, former to obtainThe beginning play instruction of beginning voice data, described original audio data and described original audio data institute dominantThe source of sound precedence information in source, if the source of sound under described original audio data and the audio frequency number of current broadcastingAccording to source of sound not identical, make it possible to according under described beginning play instruction, described original audio dataThe source of sound precedence information of source of sound and the source of sound precedence information of described current broadcasting source of sound, arrange described formerThe broadcast sound volume of source of sound and the broadcast sound volume of current broadcasting source of sound under beginning voice data, and with described originalThe broadcast sound volume of source of sound and the broadcast sound volume of described current broadcasting source of sound under voice data, to described originalThe voice data of voice data and described current broadcasting source of sound, carries out audio mixing playback process, due to without oftenThe corresponding audio-frequency module of individual source of sound carries out synchronous communication with the corresponding audio-frequency module of other sources of sound again, withDetermine whether self can carry out voice data transmission, but by the beginning play instruction of voice data and thisUnder voice data the source of sound precedence information of source of sound add in voice data, send to together interconnected shouldWith, carry out volume setting by interconnecting application unification, with different volumes, play the sound of different sources of sound simultaneouslyAudio data, therefore, can avoid in prior art causing due to the synchronous communication between audio-frequency moduleThe problem of the waste of system resource.

From described technical scheme, on the other hand, the embodiment of the present invention is by receiving first terminal equipmentOn corresponding the second terminal device of interconnecting application on described the second terminal of sending of fit applications establishThe voice data to be played of at least two standby sources of sound, and then sound to be played to described at least two sources of soundIn audio data, the voice data to be played of each source of sound carries out dissection process, to obtain described each source of soundThe beginning play instruction of the original audio data of original audio data, described each source of sound and described each soundThe source of sound precedence information in source, makes it possible to according to described beginning play instruction and described source of sound priority letterBreath, arranges the broadcast sound volume of described each source of sound, and with the broadcast sound volume of described each source of sound, to describedThe original audio data of each source of sound, carries out audio mixing playback process, due to corresponding without each source of soundWhether audio-frequency module carries out synchronous communication with the corresponding audio-frequency module of other sources of sound again, self can to determineTo carry out voice data transmission, but by the beginning play instruction of voice data and this voice data institute dominantThe source of sound precedence information in source adds in voice data and sends to together interconnecting application, is united by interconnecting applicationOne carries out volume setting, with different volumes, plays the voice data of different sources of sound simultaneously, therefore, and energyEnough avoid the waste of the system resource causing due to the synchronous communication between audio-frequency module in prior artProblem.

In addition, adopt technical scheme provided by the present invention, can greatly promote user and experience.

[brief description of the drawings]

In order to be illustrated more clearly in the technical scheme in the embodiment of the present invention, below will be to embodiment or existingIn technical description, the accompanying drawing of required use is briefly described, apparently, in the following describesAccompanying drawing is some embodiments of the present invention, for those of ordinary skill in the art, is not paying creationUnder the prerequisite of property work, can also obtain according to these accompanying drawings other accompanying drawing.

The schematic flow sheet of the control method of a kind of terminal device that Fig. 1 provides for one embodiment of the invention;

The flow process signal of the control method of the another kind of terminal device that Fig. 2 provides for another embodiment of the present inventionFigure;

The flow process signal of the control method of the another kind of terminal device that Fig. 3 provides for another embodiment of the present inventionFigure;

The structural representation of the control device of a kind of terminal device that Fig. 4 provides for another embodiment of the present invention;

The structural representation of the control device of the another kind of terminal device that Fig. 5 provides for another embodiment of the present inventionFigure;

The structural representation of the control device of the another kind of terminal device that Fig. 6 provides for another embodiment of the present inventionFigure.

[detailed description of the invention]

For making object, technical scheme and the advantage of the embodiment of the present invention clearer, below in conjunction with thisAccompanying drawing in bright embodiment, is clearly and completely described the technical scheme in the embodiment of the present invention,Obviously, described embodiment is the present invention's part embodiment, instead of whole embodiment. Based onEmbodiment in the present invention, those of ordinary skill in the art obtain not making under creative work prerequisiteWhole other embodiment that obtain, belong to the scope of protection of the invention.

It should be noted that, subscriber terminal equipment related in the embodiment of the present invention can comprise but not limitIn mobile phone, personal digital assistant (PersonalDigitalAssistant, PDA), radio hand-held equipment,Panel computer (TabletComputer), PC (PersonalComputer, PC), MP3Player, MP4 player, wearable device (for example, intelligent glasses, intelligent watch, intelligent braceletDeng) etc. Related vehicle-mounted terminal equipment in the embodiment of the present invention, can also be called car machine, refers toBe arranged on the abbreviation of the on-vehicle information amusing products of automobile the inside, car machine in function, want to realize people withCar, the information communication of car and extraneous (car and car).

In addition, term "and/or" herein, is only a kind of incidence relation of describing affiliated partner, representsCan have three kinds of relations, for example, A and/or B, can represent: individualism A exists A simultaneouslyAnd B, these three kinds of situations of individualism B. In addition, character "/" herein, generally represents forward-backward correlation pairAs if a kind of relation of "or".

The schematic flow sheet of the control method of a kind of terminal device that Fig. 1 provides for one embodiment of the invention,As shown in Figure 1.

101, obtain the original audio of the second terminal device that interconnecting application place first terminal equipment connectsData.

In the present invention, first terminal equipment and the second terminal device through but not limited to bluetooth be connected, generalUniversal serial bus (UniversalSerialBus, USB) connects and wireless compatibility certification (WirelessFidelity, WI-FI) at least one connect in connecting, the present embodiment is not particularly limited this.

102, by source of sound under the beginning play instruction of described original audio data and described original audio dataSource of sound precedence information add in described original audio data, to obtain voice data to be played.

103, by described voice data to be played, send to described interconnecting application.

It should be noted that, 101～103 executive agent can be for the application that is positioned at the second terminal deviceThe corresponding fit applications of interconnecting application, or can also be for being arranged on the application that is positioned at the second terminal devicePlug-in unit or SDK (Software in (being the corresponding fit applications of interconnecting application)DevelopmentKit, SDK) etc. functional unit, the present embodiment is not particularly limited this.

Be understandable that, described application can be mounted in the local program on the second terminal device, or can also be a web page program of the browser on the second terminal device (nativeApp)(webApp), the present embodiment is not particularly limited this.

Like this, by obtaining the former of the second terminal device that interconnecting application place first terminal equipment connectsBeginning voice data, and then by the beginning play instruction of described original audio data and described original audio dataThe source of sound precedence information of affiliated source of sound adds in described original audio data, to obtain audio frequency to be playedData, make it possible to, by described voice data to be played, send to described interconnecting application, due to without oftenThe corresponding audio-frequency module of individual source of sound carries out synchronous communication with the corresponding audio-frequency module of other sources of sound again, withDetermine whether self can carry out voice data transmission, but by the beginning play instruction of voice data and thisUnder voice data the source of sound precedence information of source of sound add in voice data, send to together interconnected shouldWith, carry out volume setting by interconnecting application unification, with different volumes, play the sound of different sources of sound simultaneouslyAudio data, therefore, can avoid in prior art causing due to the synchronous communication between audio-frequency moduleThe problem of the waste of system resource.

Alternatively, in one of the present embodiment possible implementation, described first terminal equipment is preferredFor vehicle-mounted terminal equipment; Described the second terminal device is preferably subscriber terminal equipment.

Conversely, described first terminal equipment can be also subscriber terminal equipment; Described the second terminal deviceAlso can be vehicle-mounted terminal equipment. But in actual applications, that installs on subscriber terminal equipment shouldWith carrying out separately, could normally use without relying on connected another terminal device, orPerson relies on and on connected another terminal device, a corresponding fit applications is installed and could normally makesWith.

In the present invention, set up it at the equipment connection completing between first terminal equipment and the second terminal deviceAfter, based on set up equipment connection, also need further to set up the interconnecting application on first terminal equipmentAnd the communication connection between the fit applications on the second terminal device. Like this, user just can be by interconnectedApplication, cooperation application or fit applications place the second terminal device.

Be understandable that, described communication connection can include but not limited to bluetooth connect, USB connect andAt least one item during WI-FI connects, the present embodiment is not particularly limited this.

Alternatively, in one of the present embodiment possible implementation, in 101, the institute receivingStating the original audio data of the second terminal device, can be corresponding described the second end of described interconnecting applicationThe voice data of the fit applications on end equipment, for example, song voice data that fit applications is obtained,The TTS voice data (TextToSpeech, TTS) that the navigation feature of fit applications is exported etc.,Or can also be the audio frequency of other application except described fit applications on described the second terminal deviceData, for example, the song voice data that QQ music is obtained etc., the present embodiment is not limit especially to thisFixed.

So-called voice data, refers to by the data signal that audio signal is converted, for example, and to instituteState the audio signal processing of sampling, quantize and encode, the pulse code modulation (PulseCode obtainingModulation, PCM) data. The detailed description that coding is processed can be referring to of the prior art relevantContent repeats no more herein. Finally, after voice data is carried out to form coding, just formed codingThe audio file of form.

Wherein, described audio file can comprise the audio file of various coded formats in prior art, exampleAs, dynamic image expert group (MovingPictureExpertsGroup, MPEG) layer 3(MPEGLayer-3, MP3) format audio file, WMA (WindowsMediaAudio,WMA) format audio file, Advanced Audio Coding (AdvancedAudioCoding, AAC) latticeFormula audio file or APE format audio file etc., the present embodiment is not particularly limited this.

Particularly, if the music function that user applies at collaboration, specifically can be from the second terminal deviceMemory device or internet on, obtain pending audio file, for example, the MP3 of song to be playedFormat audio file etc., and then, can carry out decoding place to the data block of described pending audio fileReason, to obtain described original audio data. The detailed description that decoding is processed can be referring to of the prior artRelated content repeats no more herein. If user, specifically can be straight in the navigation feature of collaboration applicationObtain and get TTS voice data (TextToSpeech, TTS).

In a concrete implementation procedure, the memory device of described the second terminal device can be stored at a slow speedEquipment, is specifically as follows the hard disk of computer system, or can also is thing for the inoperative internal memory of mobile phoneReason internal memory, for example, read-only storage (Read-OnlyMemory, ROM) and RAM card etc., this realityExecuting example is not particularly limited this.

In another concrete implementation procedure, the memory device of described the second terminal device can also be fastSpeed memory device, is specifically as follows the internal memory of computer system, or can also is the running memory of mobile phoneBe Installed System Memory, for example, random access memory (RandomAccessMemory, RAM) etc., thisEmbodiment is not particularly limited this.

Described beginning play instruction, can be called again initialization directive, in order to instruction, track is carried out initiallyChange operation, utilize through initialized track, start playing audio-fequency data. So-called track, for inciting somebody to actionAudio data recording is at specific time location, and carries out playback process. Specifically, starting broadcasting refers toIn order, can comprise format parameter, like this, receiving terminal can, according to this format parameter, carry out trackInitialization operation.

Wherein, described format parameter can include but not limited to compressed format, sample rate, sampling depth andAt least one item in code check.

Described sample rate, also referred to as sample rate or sample frequency, has defined per second from continuous signalExtract and form the number of samples of discrete signal, it represents with hertz (Hz).

Described sampling depth, refers to that the value of a sampled point is represented by several bit numbers, and it has determined each adoptingThe figure place of the value of sampling point, for example, 8 bits (bit), 16 or 24 etc.

Described code check, refers to the quantity of the bit of processing in the unit interval, and unit is bit per second (bps).

Alternatively, in one of the present embodiment possible implementation, before 102, can also enterOne step is carried out the operation of the beginning play instruction that obtains described original audio data.

In a concrete implementation procedure, specifically can obtain user and operate described the second terminal deviceAudio frequency associative operation event data, and then can, according to described audio frequency associative operation event data, obtainThe beginning play instruction of described original audio data, for example, music fuction output song in fit applicationsThe beginning play instruction of voice data.

So-called audio frequency associative operation event data, for the Action Events data of operating audio data. ToolBody ground, communication connection that specifically can be based between fit applications and described interconnecting application, obtains described useFamily operates the relevant behaviour of audio frequency of described the second terminal device by the interconnecting application on described first terminal equipmentMake event data.

In the present invention, so-called user is by the interconnecting application operation and described first on first terminal equipmentThe audio frequency associative operation event data of the second terminal device that terminal device connects, refers to that user first eventuallyThe audio frequency associative operation behavior of carrying out in interconnecting application on end equipment, for example, clicks, double-clicks, dragsMoving wait operation, be mapped to the dependency number of the audio frequency associative operation event in the display unit of the second terminal deviceAccording to, can include but not limited to the number of coordinates of audio frequency associative operation event and described audio frequency associative operation eventAccording to.

For example, the interconnecting application on first terminal equipment, can be interconnected by this on the second terminal deviceApply corresponding fit applications, in the display unit of first terminal equipment, project the second terminal deviceThe interface that display unit is exported, user can be by grasping on the interface projecting in interconnecting applicationDo, for example, touch control operation or physical button operation etc., like this, just can realize operation and its place theThe voice data of the whole application on the second terminal device that one terminal device connects, i.e. this interconnecting application instituteThe voice data of corresponding fit applications and other except the corresponding fit applications of this interconnecting applicationThe voice data of application.

Or, more for example, the interconnecting application on first terminal equipment, can also pass through the second terminal deviceOn the corresponding fit applications of this interconnecting application, as an operating side for example, mouse or remote controller etc.,User can be by operating in interconnecting application, for example, and touch control operation or physical button operation etc.,Like this, just can realize whole on operation and the second terminal device of its place first terminal equipment connectionThe voice data of application, i.e. the voice data of the corresponding fit applications of this interconnecting application and interconnected except thisApply the voice data of other application outside corresponding fit applications.

Be understandable that, specifically can be according to the display size of the display unit of first terminal equipment andThe ratio of the display size of the display unit of two terminal devices, interconnected by user on first terminal equipmentThe coordinate data of the operation behavior of carrying out in application, is mapped in the display unit of the second terminal deviceThe coordinate data of Action Events.

Conventionally, current terminal device is all the terminal device of touch type, and its display unit is except havingOutside Presentation Function, also there is touch-control input function. Any one in the display unit of terminal deviceOperation behavior, all needs to be broken down into the set of several Action Events, and operating system can be to theseThe related data of Action Events is carried out respective handling. Particularly, described Action Events comprises in following eventAt least one:

Down event;

Up event; And

Move event.

So-called Down event only can trigger once in once-through operation behavior, be rigidly connect at finger tactileWhen the display unit of terminal device, trigger.

So-called Up event only can trigger once in once-through operation behavior, is to leave terminal at finger to establishWhen standby display unit, trigger.

So-called Move event can trigger 0,1 or multiple in the process of once-through operation behaviorMove event if finger moves in the display unit of terminal device always, will trigger Move alwaysEvent, and be all after Down event with Up event before.

In another concrete implementation procedure, specifically can obtain described interconnecting application corresponding described inOn fit applications on the second terminal device or described the second terminal device except described fit applicationsThe beginning play instruction of other described original audio data of triggering of application, for example, the leading of fit applicationsThe beginning play instruction triggering when boat fuction output TTS voice data.

Alternatively, in one of the present embodiment possible implementation, in 102, specifically can be byDescribed beginning play instruction and described source of sound precedence information add in blank frame, to generate audio frequency controlFrame, and then, described audio frequency control frame can be inserted in described original audio data, to obtainState voice data to be played.

Particularly, specifically can be inserted into described original audio by starting play instruction place audio frequency control frameBefore data, and then, can be according to preset data size as 30,000 (k) bytes or when defaultBetween size as 20 milliseconds (ms) etc., the original audio data after audio frequency control frame is carried out to segment processing,To obtain some section audio data, every section audio data are added to the data division of blank frame, to obtainSeveral audio data frames. Like this, by obtained audio data frame and audio frequency control frame, just formedVoice data to be played.

In a concrete implementation procedure, specifically can add described beginning play instruction to described soundIn the frame head of frequency control frame, or can also add described beginning play instruction to described audio frequency control frameData division in, the present embodiment is not particularly limited this.

Adopt technical scheme provided by the present invention, can, in the process of transmitting of Multi-audio-frequency data, reduceDirectly synchronous communication between different sources of sound, reduces system audio synchronously and the design difficulty of transmission, effectivelyUtilized system resource, meanwhile, can also effectively strengthen the stability of a system.

In the present embodiment, establish by obtaining the second terminal that interconnecting application place first terminal equipment connectsStandby original audio data, and then by the beginning play instruction of described original audio data and described original soundUnder audio data, the source of sound precedence information of source of sound adds in described original audio data, waits to broadcast to obtainPlayback audio data, makes it possible to, by described voice data to be played, send to described interconnecting application, due toSynchronously lead to the corresponding audio-frequency module of other sources of sound again without the corresponding audio-frequency module of each source of soundLetter, to determine whether self can carry out voice data transmission, but refers to the broadcasting that starts of voice dataOrder sends to mutually together with adding in voice data with the source of sound precedence information of source of sound under this voice dataConnection application, carries out volume setting by interconnecting application unification, with different volumes, plays different sources of sound simultaneouslyVoice data, therefore, can avoid in prior art because the synchronous communication between audio-frequency module is ledThe problem of the waste of the system resource causing.

The flow process signal of the control method of the another kind of terminal device that Fig. 2 provides for another embodiment of the present inventionFigure, as shown in Figure 2.

201, the cooperation receiving on corresponding the second terminal device of interconnecting application on first terminal equipment shouldWith the voice data to be played of sent described the second terminal device.

202, described voice data to be played is carried out to dissection process, with obtain original audio data, described inThe source of sound priority of source of sound letter under the beginning play instruction of original audio data and described original audio dataBreath.

If the source of sound under 203 described original audio data and the not phase of source of sound of the voice data of current broadcastingWith, according to the source of sound precedence information of source of sound under described beginning play instruction, described original audio dataWith the source of sound precedence information of described current broadcasting source of sound, source of sound under described original audio data is setThe broadcast sound volume of broadcast sound volume and current broadcasting source of sound.

204, with the broadcast sound volume of source of sound under described original audio data and broadcasting of described current broadcasting source of soundPlayback amount, to the voice data of described original audio data and described current broadcasting source of sound, carries out audio mixing and broadcastsPut processing.

It should be noted that, 201～204 executive agent can be for the application that is positioned at first terminal equipmentInterconnecting application, or can also be for being arranged on the application (being interconnecting application) that is arranged in first terminal equipmentThe functional unit such as plug-in unit or SDK (SoftwareDevelopmentKit, SDK),The present embodiment is not particularly limited this.

Be understandable that, described interconnecting application can be mounted in the local program on first terminal equipment, or can also be a web page program of the browser on first terminal equipment (nativeApp)(webApp), the present embodiment is not particularly limited this.

Like this, by receiving on corresponding the second terminal device of interconnecting application on first terminal equipmentThe voice data to be played of described the second terminal device that fit applications sends, and then to described to be playedVoice data carries out dissection process, with obtain original audio data, described original audio data start broadcastPut the source of sound precedence information of the affiliated source of sound of instruction and described original audio data, if described original audio numberNot identical with the source of sound of the voice data of current broadcasting according to affiliated source of sound, make it possible to according to described beginningSource of sound precedence information and the described current broadcasting sound of source of sound under play instruction, described original audio dataThe source of sound precedence information in source, arranges broadcast sound volume and current the broadcasting of source of sound under described original audio dataThe broadcast sound volume in playback source, and with the broadcast sound volume of source of sound under described original audio data and described currentPlay the broadcast sound volume of source of sound, to the voice data of described original audio data and described current broadcasting source of sound,Carry out audio mixing playback process, due to right with other source of sound institutes again without the corresponding audio-frequency module of each source of soundThe audio-frequency module of answering carries out synchronous communication, to determine whether self can carry out voice data transmission, butThe source of sound precedence information of source of sound under the beginning play instruction of voice data and this voice data is added toIn voice data, send to together interconnecting application, carry out volume setting by interconnecting application unification, with differentVolume is play the voice data of different sources of sound simultaneously, therefore, can avoid in prior art due to audio frequencyThe problem of the waste of the synchronous communication between module and the system resource that causes.

It should be noted that, first terminal equipment, interconnecting application, the second terminal device and fit applications,Function and description, first terminal equipment in the embodiment corresponding with Fig. 1, interconnecting application, second are eventuallyEnd equipment and fit applications, function with describe be consistent, detailed description can be referring to Fig. 1 correspondenceEmbodiment in related content, repeat no more herein.

In the present invention, the voice data to be played receiving, is to adopt embodiment corresponding to Fig. 1 to provideTechnical scheme, produce and send. Detailed description can be referring in embodiment corresponding to Fig. 1 relevantContent repeats no more herein.

Alternatively, in one of the present embodiment possible implementation, in 202, specifically can be rightDescribed voice data to be played carries out dissection process, to obtain described original audio data, audio frequency control frameIn described beginning play instruction and the described source of sound precedence information in described audio frequency control frame.

In a concrete implementation procedure, specifically can be to the audio frequency control in described voice data to be playedThe frame head of frame processed carries out dissection process, to obtain described beginning play instruction and the institute in this audio frequency control frameState source of sound precedence information, and data division to the audio data frame in described voice data to be playedCarry out dissection process, to obtain the described original audio data in this audio data frame.

In another concrete implementation procedure, specifically can be to the audio frequency in described voice data to be playedThe data division of control frame carries out dissection process, starts to play and refers to obtain described in this audio frequency control frameOrder and described source of sound precedence information, and number to the audio data frame in described voice data to be playedCarry out dissection process according to part, to obtain the described original audio data in this audio data frame.

Alternatively, in one of the present embodiment possible implementation, in 203, if described originalSource of sound under voice data is not identical with the source of sound of the voice data of current broadcasting, can be according to describedStart play instruction, the source of sound precedence information to source of sound under described original audio data and described currentThe source of sound precedence information of playing source of sound compares processing.

If the source of sound precedence information of source of sound is higher than described current broadcasting source of sound under described original audio dataSource of sound precedence information, the broadcast sound volume that source of sound under described original audio data can be set higher thanThe broadcast sound volume of current broadcasting source of sound.

If the source of sound precedence information of source of sound is lower than described current broadcasting source of sound under described original audio dataSource of sound precedence information, the broadcast sound volume that source of sound under described original audio data can be set lower thanThe broadcast sound volume of current broadcasting source of sound.

Setting up the broadcast sound volume of source of sound and the broadcasting of current broadcasting source of sound under described original audio dataAfter volume, in 204, can be according to starting included format parameter in play instruction, to removingAnother track of playing outside the track of voice data of described current broadcasting source of sound initialize behaviourDo, utilize through initialized track, with the broadcast sound volume of each source of sound, start to play described original soundAudio data, plays with the audio mixing of realizing source of sound under current broadcasting source of sound and described original audio data.

Alternatively, in one of the present embodiment possible implementation, if finish described originalVoice data, and still receive the voice data of described current broadcasting source of sound, can be with described settingBroadcast sound volume before, the voice data of described current broadcasting source of sound is play in continuation.

Alternatively, in one of the present embodiment possible implementation, if finish described currentPlay the voice data of source of sound, and still receive described original audio data, can be with described settingBroadcast sound volume before, continues to play described original audio data.

In the present embodiment, establish by corresponding the second terminal of interconnecting application receiving on first terminal equipmentThe voice data to be played of described the second terminal device that standby upper fit applications sends, and then to describedVoice data to be played carries out dissection process, to obtain original audio data, described original audio dataStart the source of sound precedence information of the affiliated source of sound of play instruction and described original audio data, if described originalSource of sound under voice data is not identical with the source of sound of the voice data of current broadcasting, makes it possible to according to instituteState and start the source of sound precedence information of source of sound under play instruction, described original audio data and described currentPlay the source of sound precedence information of source of sound, arrange source of sound under described original audio data broadcast sound volume andThe broadcast sound volume of current broadcasting source of sound, and with broadcast sound volume and the institute of source of sound under described original audio dataState the broadcast sound volume of current broadcasting source of sound, to the sound of described original audio data and described current broadcasting source of soundAudio data, carries out audio mixing playback process, due to without the corresponding audio-frequency module of each source of sound again with otherThe corresponding audio-frequency module of source of sound carries out synchronous communication, to determine that self whether can carry out voice data sends outSend, but by the source of sound priority letter of source of sound under the beginning play instruction of voice data and this voice dataBreath adds in voice data and sends to together interconnecting application, carries out volume setting by interconnecting application unification,With different volumes, play the voice data of different sources of sound simultaneously, therefore, can avoid in prior artThe problem of the waste of the system resource causing due to the synchronous communication between audio-frequency module.

The flow process signal of the control method of the another kind of terminal device that Fig. 3 provides for another embodiment of the present inventionFigure, as shown in Figure 3.

301, the cooperation receiving on corresponding the second terminal device of interconnecting application on first terminal equipment shouldWith the voice data to be played of at least two sources of sound of sent described the second terminal device.

302, the audio frequency number to be played to each source of sound in the voice data to be played of described at least two sources of soundAccording to carrying out dissection process, to obtain the former of the original audio data of described each source of sound, described each source of soundThe beginning play instruction of beginning voice data and the source of sound precedence information of described each source of sound.

303, according to described beginning play instruction and described source of sound precedence information, described each source of sound is setBroadcast sound volume.

304, with the broadcast sound volume of described each source of sound, to the original audio data of described each source of sound, enterRow audio mixing playback process.

It should be noted that, 301～304 executive agent can be for the application that is positioned at first terminal equipmentInterconnecting application, or can also be for being arranged on the application (being interconnecting application) that is arranged in first terminal equipmentThe functional unit such as plug-in unit or SDK (SoftwareDevelopmentKit, SDK),The present embodiment is not particularly limited this.

Like this, by receiving on corresponding the second terminal device of interconnecting application on first terminal equipmentThe voice data to be played of at least two sources of sound of described the second terminal device that fit applications sends, entersAnd the voice data to be played of each source of sound in the voice data to be played of described at least two sources of sound is carried outDissection process, to obtain the original audio data of described each source of sound, the original audio of described each source of soundThe beginning play instruction of data and the source of sound precedence information of described each source of sound, make it possible to described in basisStart play instruction and described source of sound precedence information, the broadcast sound volume of described each source of sound is set, and withThe broadcast sound volume of described each source of sound, to the original audio data of described each source of sound, carries out audio mixing broadcastingProcess, due to without the corresponding audio-frequency module of each source of sound again with the corresponding audio-frequency module of other sources of soundCarry out synchronous communication, to determine whether self can carry out voice data transmission, but by voice dataStart under play instruction and this voice data the source of sound precedence information of source of sound and add in voice data one toRise and send to interconnecting application, carry out volume setting by interconnecting application unification, with different volumes, broadcast simultaneouslyPut the voice data of different sources of sound, therefore, can avoid in prior art same due between audio-frequency moduleThe problem of the waste of the system resource that walks communication and cause.

Alternatively, in one of the present embodiment possible implementation, in 302, specifically can be rightThe voice data to be played of described each source of sound carries out dissection process, to obtain the original of described each source of soundDescribed sound in described beginning play instruction and described audio frequency control frame in voice data, audio frequency control frameSource precedence information.

In a concrete implementation procedure, specifically can be to the voice data to be played of described each source of soundIn the frame head of audio frequency control frame carry out dissection process, to obtain the described each sound in this audio frequency control frameThe beginning play instruction of the original audio data in source and the source of sound precedence information of described each source of sound, andData division to the audio data frame in the voice data to be played of described each source of sound carry out parsing placeReason, to obtain the original audio data of the described each source of sound in this audio data frame.

In another concrete implementation procedure, specifically can be to the audio frequency number to be played of described each source of soundAccording in the data division of audio frequency control frame carry out dissection process, with obtain in this audio frequency control frame described inThe beginning play instruction of the original audio data of each source of sound and the source of sound priority of described each source of sound letterBreath, and the data division of the audio data frame in the voice data to be played of described each source of sound is carried outDissection process, to obtain the original audio data of the described each source of sound in this audio data frame.

Alternatively, in one of the present embodiment possible implementation, in 303, specifically can rootAccording to the beginning play instruction of the original audio data of described each source of sound, excellent to the source of sound of described each source of soundFirst level information compares processing.

According to source of sound precedence information order from high to low, set gradually from big to small broadcasting of each source of soundPlayback amount, source of sound precedence information is higher, and the broadcast sound volume of its corresponding source of sound is larger. Source of sound is excellentThe first the highest source of sound of level information, its broadcast sound volume maximum; The source of sound that source of sound precedence information is minimum, it is broadcastPlayback amount minimum.

Setting up the broadcast sound volume of described each source of sound, in 304, can be according to this source of sound formerIncluded format parameter in the beginning play instruction of beginning voice data, to the corresponding track of each source of soundCarry out initialization operation, utilize through initialized track, with the broadcast sound volume of described each source of sound, openBegin to play the original audio data of the corresponding source of sound of institute, to realize the audio mixing broadcasting of multiple sources of sound.

It should be noted that, the track quantity that specifically can support according to first terminal equipment, specifically realExisting 303 and 304 these two steps.

As a rule, the multitone rail quantity that first terminal equipment is supported is two, so, if obtainedTo the original audio data of more than three or three sources of sound, in concrete implementation procedure, can be onlySelect two the highest sources of sound of source of sound precedence information, carry out the setting operation of its broadcast sound volume, Yi JigenAccording to included format parameter in the beginning play instruction of the original audio data of these two sources of sound, to eachThe corresponding track of source of sound carries out initialization operation, utilizes through initialized track, with described each soundThe broadcast sound volume in source, start to play the original audio data of corresponding source of sound, to realize these two sources of soundAudio mixing is play.

And broadcast sound volume to other sources of sound can no longer be carried out the setting operation of its broadcast sound volume, entersAnd also no longer play the original audio data of these sources of sound, the original audio data of these sources of sound is lostAbandon processing.

In the present embodiment, establish by corresponding the second terminal of interconnecting application receiving on first terminal equipmentThe audio frequency number to be played of at least two sources of sound of described the second terminal device that standby upper fit applications sendsAccording to, and then audio frequency number to be played to each source of sound in the voice data to be played of described at least two sources of soundAccording to carrying out dissection process, to obtain the former of the original audio data of described each source of sound, described each source of soundThe beginning play instruction of beginning voice data and the source of sound precedence information of described each source of sound, make it possible to rootAccording to described beginning play instruction and described source of sound precedence information, the broadcast sound volume of described each source of sound is set,And with the broadcast sound volume of described each source of sound, to the original audio data of described each source of sound, carry out audio mixingPlayback process, due to without the corresponding audio-frequency module of each source of sound again with the corresponding audio frequency of other sources of soundModule is carried out synchronous communication, to determine whether self can carry out voice data transmission, but by audio frequency numberAccording to beginning play instruction and this voice data under the source of sound precedence information of source of sound add voice data toIn send to together interconnecting application, carry out volume setting by interconnecting application unification, with different volumes, withTime play the voice data of different sources of sound, therefore, can avoid in prior art due between audio-frequency moduleSynchronous communication and the problem of the waste of the system resource that causes.

It should be noted that, for aforesaid each embodiment of the method, for simple description, therefore it is all shownState as a series of combination of actions, but those skilled in the art should know, the present invention be not subject to retouchThe restriction of the sequence of movement of stating, because according to the present invention, some step can adopt other orders or sameShi Jinhang. Secondly, those skilled in the art also should know, the embodiment described in description all belongs toIn preferred embodiment, related action and module might not be that the present invention is necessary.

In described embodiment, the description of each embodiment is all emphasized particularly on different fields, in certain embodiment, do not haveThe part describing in detail, can be referring to the associated description of other embodiment.

The structural representation of the control device of a kind of terminal device that Fig. 4 provides for another embodiment of the present invention,As shown in Figure 4. The control device of the terminal device of the present embodiment can comprise acquiring unit 41, point frame listUnit 42 and transmitting element 43. Wherein, acquiring unit 41, for obtaining interconnecting application place first terminalThe original audio data of the second terminal device that equipment connects; Point frame unit 42, for by described originalUnder the beginning play instruction of voice data and described original audio data, the source of sound precedence information of source of sound addsBe added in described original audio data, to obtain voice data to be played; Transmitting element 43, for by instituteState voice data to be played, send to described interconnecting application.

It should be noted that, the control device of the terminal device of the present embodiment can be established for being positioned at the second terminalStandby application is the corresponding fit applications of interconnecting application, or can also be positioned at the second terminal for being arranged onPlug-in unit or SDK in the application (being the corresponding fit applications of interconnecting application) of equipmentFunctional units such as (SoftwareDevelopmentKit, SDK), the present embodiment does not carry out this especiallyLimit.

Alternatively, in one of the present embodiment possible implementation, described acquiring unit 41 is obtainedThe original audio data of described the second terminal device, can be described interconnecting application corresponding describedThe voice data of the fit applications on two terminal devices, for example, the song audio frequency number that fit applications is obtainedThe TTS voice data (TextToSpeech, TTS) of exporting according to the navigation feature of, fit applicationsDeng, or can also be other application except described fit applications on described the second terminal deviceVoice data, for example, the song voice data that QQ music is obtained etc., the present embodiment does not carry out spy to thisXian Ding not.

Alternatively, in one of the present embodiment possible implementation, described point of frame unit 42, also canOperate the audio frequency associative operation event data of described the second terminal device to be further used for obtaining user; WithAnd according to described audio frequency associative operation event data, obtain the beginning play instruction of described original audio data.

Alternatively, in one of the present embodiment possible implementation, described point of frame unit 42, also canBe further used for obtaining fit applications on corresponding described the second terminal device of described interconnecting application orThe described original sound that other application on described the second terminal device except described fit applications triggerThe beginning play instruction of audio data.

Alternatively, in one of the present embodiment possible implementation, described point of frame unit 42, concreteCan be for described beginning play instruction and described source of sound precedence information are added in blank frame, with lifeBecome audio frequency control frame; And described audio frequency control frame is inserted in described original audio data, to obtainDescribed voice data to be played.

Method in embodiment corresponding to Fig. 1, the terminal that can be provided by the present embodiment are providedThe control device of equipment is realized. Detailed description can be referring to the related content in embodiment corresponding to Fig. 1,Repeat no more herein.

In the present embodiment, obtain by acquiring unit that interconnecting application place first terminal equipment connectsThe original audio data of two terminal devices, so by point frame unit by described original audio data start broadcastThe source of sound precedence information of putting the affiliated source of sound of instruction and described original audio data adds described original audio toIn data, to obtain voice data to be played, make the transmitting element can be by described voice data to be played,Send to described interconnecting application, due to without the corresponding audio-frequency module of each source of sound again with other source of sound institutesCorresponding audio-frequency module carries out synchronous communication, to determine whether self can carry out voice data transmission, andThat the source of sound precedence information of source of sound under the beginning play instruction of voice data and this voice data is addedIn voice data, send to together interconnecting application, carry out volume setting by interconnecting application unification, with differenceVolume, play the voice data of different sources of sound simultaneously, therefore, can avoid in prior art due to soundThe problem of the waste of the synchronous communication between frequency module and the system resource that causes.

The structural representation of the control device of the another kind of terminal device that Fig. 5 provides for another embodiment of the present inventionFigure, as shown in Figure 5. The control device of the terminal device of the present embodiment can comprise receiving element 51, separateAnalyse unit 52, setting unit 53 and broadcast unit 54. Wherein, receiving element 51, for receiving firstFit applications on corresponding the second terminal device of interconnecting application on terminal device sends describedThe voice data to be played of at least two sources of sound of two terminal devices; Resolution unit 52, for treating describedPlaying audio-fequency data carries out dissection process, to obtain opening of original audio data, described original audio dataThe source of sound precedence information of source of sound under beginning play instruction and described original audio data; Setting unit 53,If it is not identical with the source of sound of the voice data of current broadcasting for the source of sound under described original audio data,According to source of sound precedence information and the institute of source of sound under described beginning play instruction, described original audio dataState the source of sound precedence information of current broadcasting source of sound, the broadcasting of the affiliated source of sound of described original audio data is setThe broadcast sound volume of volume and current broadcasting source of sound; Broadcast unit 54, for described original audio data instituteThe broadcast sound volume of the broadcast sound volume in dominant source and described current broadcasting source of sound, to described original audio data andThe voice data of described current broadcasting source of sound, carries out audio mixing playback process.

It should be noted that, the control device of the terminal device of the present embodiment can be established for being positioned at first terminalStandby application is interconnecting application, or the application that can also be positioned at for being arranged on first terminal equipment (mutuallyConnection application) in plug-in unit or SDK (SoftwareDevelopmentKit, SDK) etc.Functional unit, the present embodiment is not particularly limited this.

It should be noted that, first terminal equipment, interconnecting application, the second terminal device and fit applications,Function and description, first terminal equipment in the embodiment corresponding with Fig. 4, interconnecting application, second are eventuallyEnd equipment and fit applications, function with describe be consistent, detailed description can be referring to Fig. 4 correspondenceEmbodiment in related content, repeat no more herein.

In the present invention, the voice data to be played that receiving element 51 receives, is to adopt reality corresponding to Fig. 4Execute the technical scheme that example provides, produce and send. Detailed description can be referring to enforcement corresponding to Fig. 4Related content in example repeats no more herein.

Alternatively, in one of the present embodiment possible implementation, described resolution unit 52 is concreteCan be for described voice data to be played is carried out to dissection process, with obtain described original audio data,Described source of sound priority letter in described beginning play instruction in audio frequency control frame and described audio frequency control frameBreath.

Alternatively, in one of the present embodiment possible implementation, described broadcast unit 53, also canIf to be further used for finishing described original audio data, and still receive described current broadcasting soundThe voice data in source, with the broadcast sound volume before described setting, the described current broadcasting source of sound of continuation broadcastingVoice data.

Alternatively, in one of the present embodiment possible implementation, described broadcast unit 53, also canIf to be further used for finishing the voice data of described current broadcasting source of sound, and described in still receivingOriginal audio data, with the broadcast sound volume before described setting, continues to play described original audio data.

Method in embodiment corresponding to Fig. 2, the terminal that can be provided by the present embodiment are providedThe control device of equipment is realized. Detailed description can be referring to the related content in embodiment corresponding to Fig. 2,Repeat no more herein.

In the present embodiment, receive the interconnecting application corresponding on first terminal equipment by receiving elementThe waiting of at least two sources of sound of described the second terminal device that the fit applications on two terminal devices sends broadcastPlayback audio data, and then by resolution unit, described voice data to be played is carried out to dissection process, to obtainUnder the beginning play instruction and described original audio data of original audio data, described original audio dataThe source of sound precedence information of source of sound, if the source of sound under described original audio data and the audio frequency of current broadcastingThe source of sound of data is not identical, makes the setting unit can be according to described beginning play instruction, described original soundThe source of sound precedence information of source of sound and the source of sound precedence information of described current broadcasting source of sound under audio data,The affiliated broadcast sound volume of source of sound of described original audio data and the broadcast sound volume of current broadcasting source of sound are set, andBy broadcast unit with the broadcast sound volume of source of sound under described original audio data and described current broadcasting source of soundBroadcast sound volume, to the voice data of described original audio data and described current broadcasting source of sound, carries out audio mixingPlayback process, due to without the corresponding audio-frequency module of each source of sound again with the corresponding audio frequency of other sources of soundModule is carried out synchronous communication, to determine whether self can carry out voice data transmission, but by audio frequency numberAccording to beginning play instruction and this voice data under the source of sound precedence information of source of sound add voice data toIn send to together interconnecting application, carry out volume setting by interconnecting application unification, with different volumes, withTime play the voice data of different sources of sound, therefore, can avoid in prior art due between audio-frequency moduleSynchronous communication and the problem of the waste of the system resource that causes.

The structural representation of the control device of the another kind of terminal device that Fig. 6 provides for another embodiment of the present inventionFigure, as shown in Figure 6. The control device of the terminal device of the present embodiment can comprise receiving element 61, separateAnalyse unit 62, setting unit 63 and broadcast unit 64. Wherein, receiving element 61, for receiving firstFit applications on corresponding the second terminal device of interconnecting application on terminal device sends describedThe voice data to be played of at least two sources of sound of two terminal devices; Resolution unit 62, for to extremely describedIn the voice data to be played of few two sources of sound, the voice data to be played of each source of sound carries out dissection process,To obtain the beginning of original audio data of the original audio data of described each source of sound, described each source of soundThe source of sound precedence information of play instruction and described each source of sound; Setting unit 63, opens for described in basisBeginning play instruction and described source of sound precedence information, arrange the broadcast sound volume of described each source of sound; Play singleUnit 64, for the broadcast sound volume with described each source of sound, to the original audio data of described each source of sound,Carry out audio mixing playback process.

In the present invention, the voice data to be played that receiving element 61 receives, is to adopt reality corresponding to Fig. 4Execute the technical scheme that example provides, produce and send. Detailed description can be referring to enforcement corresponding to Fig. 4Related content in example repeats no more herein.

Alternatively, in one of the present embodiment possible implementation, described resolution unit 62 is concreteCan carry out dissection process for the voice data to be played to described each source of sound, described each to obtainDescribed beginning play instruction and described audio frequency control frame in original audio data, the audio frequency control frame of source of soundIn described source of sound precedence information.

Method in embodiment corresponding to Fig. 3, the terminal that can be provided by the present embodiment are providedThe control device of equipment is realized. Detailed description can be referring to the related content in embodiment corresponding to Fig. 3,Repeat no more herein.

In the present embodiment, receive the interconnecting application corresponding on first terminal equipment by receiving elementThe waiting of at least two sources of sound of described the second terminal device that the fit applications on two terminal devices sends broadcastPlayback audio data, so by resolution unit to each in the voice data to be played of described at least two sources of soundThe voice data to be played of source of sound carries out dissection process, with obtain described each source of sound original audio data,The beginning play instruction of the original audio data of described each source of sound and the source of sound priority of described each source of soundInformation, can, according to described beginning play instruction and described source of sound precedence information, establish setting unitPut the broadcast sound volume of described each source of sound, and by broadcast unit the broadcast sound volume with described each source of sound, rightThe original audio data of described each source of sound, carries out audio mixing playback process, due to right without each source of sound instituteThe audio-frequency module of answering carries out synchronous communication with the corresponding audio-frequency module of other sources of sound again, to determine that self isNoly can carry out voice data transmission, but by the beginning play instruction of voice data and this voice data instituteThe source of sound precedence information in dominant source adds to and in voice data, sends to together interconnecting application, by interconnected shouldCarry out volume setting with unified, with different volumes, play the voice data of different sources of sound simultaneously, therefore,Can avoid the waste of the system resource causing due to the synchronous communication between audio-frequency module in prior artProblem.

Those skilled in the art can be well understood to, for convenience and simplicity of description, described in retouchThe system of stating, the specific works process of device and unit, can be with reference to the correspondence in preceding method embodimentProcess, does not repeat them here.

In several embodiment provided by the present invention, should be understood that, disclosed system, device andMethod, can realize by another way. For example, device embodiment described above only showsMeaning property, for example, the division of described unit, is only that a kind of logic function is divided, can when actual realizationThere to be other dividing mode, for example multiple unit or assembly can in conjunction with or can be integrated into anotherSystem, or some features can ignore, or do not carry out. Another point, each other shown or discussedCoupling or direct-coupling or communication connection can be by some interfaces, device or the INDIRECT COUPLING of unitOr communication connection, can be electrically, machinery or other form.

The described unit as separating component explanation can or can not be also physically to separate, and doesThe parts that show for unit can be or can not be also physical locations, can be positioned at a place,Or also can be distributed on multiple NEs. Can select according to the actual needs part wherein orPerson realizes whole unit the object of the present embodiment scheme.

In addition, the each functional unit in each embodiment of the present invention can be integrated in a processing unit,Also can be that the independent physics of unit exists, also can be integrated in a list in two or more unitIn unit. Described integrated unit both can adopt the form of hardware to realize, and also can adopt hardware to add softwareThe form of functional unit realizes.

The integrated unit that the described form with SFU software functional unit realizes, can be stored in a computerIn read/write memory medium. Described SFU software functional unit is stored in a storage medium, comprises some fingersOrder in order to make a computer installation (can be personal computer, audio frequency processing engine, or networkDevice etc.) or processor (processor) carry out the part steps of method described in the present invention each embodiment.And aforesaid storage medium comprises: USB flash disk, portable hard drive, read-only storage (Read-OnlyMemory,ROM), random access memory (RandomAccessMemory, RAM), magnetic disc or lightThe various media that can be program code stored such as dish.

Finally it should be noted that: above embodiment is only in order to technical scheme of the present invention to be described, but not to itRestriction; Although the present invention is had been described in detail with reference to previous embodiment, the ordinary skill of this areaPersonnel are to be understood that: its technical scheme that still can record aforementioned each embodiment is modified, orPerson is equal to replacement to part technical characterictic wherein; And these amendments or replacement do not make corresponding skillThe essence of art scheme departs from the spirit and scope of various embodiments of the present invention technical scheme.

Claims

1. a control method for terminal device, is characterized in that, comprising:

2. method according to claim 1, is characterized in that, described to described audio frequency number to be playedAccording to carrying out dissection process, to obtain the beginning play instruction of original audio data, described original audio dataSource of sound precedence information with source of sound under described original audio data, comprising:

3. method according to claim 1, is characterized in that, described method also comprises:

4. according to the method described in the arbitrary claim of claim 1～3, it is characterized in that,

Described first terminal equipment is vehicle-mounted terminal equipment;

Described the second terminal device is subscriber terminal equipment.

5. a control method for terminal device, is characterized in that, comprising:

6. method according to claim 5, is characterized in that, described to described at least two sources of soundVoice data to be played in the voice data to be played of each source of sound carry out dissection process, described in obtainingThe beginning play instruction of the original audio data of each source of sound, the original audio data of described each source of sound andThe source of sound precedence information of described each source of sound, comprising:

7. according to the method described in claim 5 or 6, it is characterized in that,

Described first terminal equipment is vehicle-mounted terminal equipment;

Described the second terminal device is subscriber terminal equipment.

8. a control device for terminal device, is characterized in that, comprising:

9. device according to claim 8, is characterized in that, described resolution unit, specifically for

10. device according to claim 8, is characterized in that, described broadcast unit, also for

Device described in 11. according to Claim 8～10 arbitrary claims, is characterized in that,

Described first terminal equipment is vehicle-mounted terminal equipment;

Described the second terminal device is subscriber terminal equipment.

The control device of 12. 1 kinds of terminal devices, is characterized in that, comprising:

13. devices according to claim 12, is characterized in that, described resolution unit, specifically usesIn

14. according to the device described in claim 12 or 13, it is characterized in that,

Described first terminal equipment is vehicle-mounted terminal equipment;

Described the second terminal device is subscriber terminal equipment.