Summary of the invention
The technical solution used in the present invention is:
The method in extension point song storehouse, comprises step:
Obtain song files from mobile terminal or internet;
From song files, extract audio accompaniment;
Audio accompaniment and video or slide files are synthesized to audio video document.
Further, the method in described extension point song storehouse also comprises step: obtain the lyrics captions of synchronizeing with song files from mobile terminal or internet, and lyrics captions are embedded to described audio video document.
Further, in the method in described extension point song storehouse, described song files comprises song audio frequency or multimedia file; Described from song files, extract audio accompaniment comprise from song audio frequency, remove original singer or promote vocal accompaniment, from multimedia file, extract song audio frequency and from song audio frequency, remove original singer or promote vocal accompaniment.
Further, in the method in described extension point song storehouse, after audio accompaniment is synthesized to audio video document with video or slide files, also comprise that mirror image is synchronizeed to perform in a radio or TV programme step, specifically comprise:
By wireless transmission method synchronous mobile terminal and audiovisual terminals;
Playback of audio-visual file;
Receive sound from mobile terminal or audiovisual terminals;
Process and play described sound.
Further, in the method in described extension point song storehouse, described wireless transmission method comprises Airplay technology, DLNA technology, Miracast technology or WIDI technology.
Further, in the method in described extension point song storehouse, obtain song files from mobile terminal or internet and specifically comprise: obtain song files by wired connection or wireless connections mode from mobile terminal or internet.
Further, in the method in described extension point song storehouse, obtaining song files from mobile terminal or internet is audio video document or pure audio file;
In the time obtaining song files from mobile terminal or internet and be audio video document, audio accompaniment and video or slide files are synthesized to audio video document and comprise step: the video in audio accompaniment and former audio video document is synthesized to audio video document;
In the time obtaining song files from mobile terminal or internet and be pure audio file, audio accompaniment and video or slide files are synthesized to audio video document and comprise step: by web search and the suitable video file of song files, and the video in audio accompaniment and video file is synthesized to audio video document, or audio accompaniment and default video or magic lantern are synthesized to new audio video document.
The system in extension point song storehouse, comprises audiovisual terminals, and server or mobile terminal;
Audiovisual terminals comprises accompaniment extraction unit, audiovisual synthesis unit, the first processing unit, the first communication unit and storage unit;
Server comprises public server or privately owned server;
The first processing unit calls the first communication unit and obtains song files from mobile terminal or server, call accompaniment extraction unit and extract audio accompaniment from described song files, call audiovisual synthesis unit audio accompaniment and video or slide files are synthesized to audio video document.
Further, in the system in described extension point song storehouse, audiovisual terminals also comprises captions embedded unit;
The first processing unit calls the first communication unit and obtains the lyrics captions of synchronizeing with song files from mobile terminal or server, and calls captions embedded unit described lyrics captions are embedded in audio video document.
Further, in the system in described extension point song storehouse, described song files comprises song audio frequency or multimedia file;
Accompaniment extraction unit is removed original singer or is promoted vocal accompaniment from song audio frequency, or processing unit extracts song audio frequency from multimedia file and accompaniment extraction unit is removed original singer or promoted vocal accompaniment from song audio frequency.
Further, in the system in described extension point song storehouse, audiovisual terminals comprises sound processing unit, the first recording unit, plays driver element and broadcast unit; Mobile terminal comprises the second recording unit, the second processing unit and the second communication unit;
After audio accompaniment and video or slide files are synthesized audio video document by audiovisual synthesis unit, the first communication unit and the second communication unit between mobile terminal and audiovisual terminals by wireless transmission method audio-video synchronization file;
The first processing unit calls plays driver element in order to control broadcast unit playback of audio-visual file;
The first processing unit is transferred the first recording unit and is received acoustic information, or the second processing unit is transferred the second recording unit reception acoustic information and by the second communication unit, described acoustic information transferred to audiovisual terminals;
The first processing unit calls sound processing unit and processes described acoustic information, and calls broadcasting driver element control broadcast unit and play treated sound.
Further, in the system in described extension point song storehouse, described wireless transmission method comprises Airplay technology, DLNA technology, Miracast technology or WIDI technology.
Further, in the system in described extension point song storehouse, the first communication unit comprises wired communication module or wireless communication module; The first communication unit obtains song files from mobile terminal or internet and specifically comprises: obtain song files by wired connection or wireless connections mode from mobile terminal or internet.
Further, in the system in described extension point song storehouse, obtaining song files from mobile terminal or server is audio video document or pure audio file;
In the time obtaining song files from mobile terminal or server and be audio video document, the video in audio accompaniment and former audio video document is synthesized audio video document by audiovisual synthesis unit;
In the time obtaining song files from mobile terminal or server and be pure audio file, the first processing unit is by web search and the suitable video file of song files, and the video in audio accompaniment and video file is synthesized audio video document by audiovisual synthesis unit; Or audio accompaniment and default video or magic lantern are synthesized new audio video document by audiovisual synthesis unit.
By taking technique scheme, the beneficial effect that the present invention obtains is: make full use of internet and the powerful storage capacity of intelligent mobile terminal and the computing ability to multimedia file, produce the accompaniment audio video document for playing Karaoka of meeting consumers' demand to the full extent, fully improve the ability that expands Qu Ku in public or private multimedia entertainment system.
Embodiment
By describing technology contents of the present invention, structural attitude in detail, being realized object and effect, below in conjunction with embodiment and coordinate accompanying drawing to be explained in detail.
Referring to Fig. 1, is the high-level schematic functional block diagram of the system in a kind of extension point song storehouse in an embodiment of the present invention; In figure dotted line represent dotted line connect two functional modules between there is communication relation.
The system in the extension point song storehouse described in present embodiment comprises audiovisual terminals 11 and server 13.Wherein, audiovisual terminals 11 comprises the first processing unit 113, the first communication unit 114, storage unit 115, accompaniment extraction unit 111 and audiovisual synthesis unit 112.The first processing unit 113 obtains song files for calling the first communication unit 114 from server 13.In another embodiment, described system also comprises mobile terminal 12, and in this embodiment, the first processing unit 113 calls the first communication unit 114 and obtains song files from mobile terminal 12.
Described song files can be only that song audio frequency is that form is the file of the pure audio forms such as mp3, wav, wma, ape, flac, acc, apple lossless, can be also the multimedia file that simultaneously comprises audio-frequency information and video information.Described mobile terminal 12 can comprise the intelligent terminals such as smart mobile phone, panel computer, PDA, ipod, MP3 player, MP4 player.The source that in prior art is song in place of public amusement or the Kara OK songs storehouse of family expenses audio-video system is conventionally all more limited, if the some song storehouse in KTV may be mainly to depend on to copyright to be purchased and to buy song, the bent storehouse of family expenses audio-video system is more limited, can only lean on user oneself to buy the bent acquiescence Qu Ku that collects or depend on audio-video system of accompaniment, in so undoubtedly Qu Ku, the degree of enriching of song is quite short of, and is particularly difficult to meet the demand of the song that user issues recently to some.The technical scheme that the present invention proposes is exactly public server 131 or the privately owned server 132 from internet, or obtains song in user's mobile terminal 12, through one series of processes being made into into accompaniment audio video document.Chant music resource on internet is vast as the open sea, in all demands that meet user almost without any difficulty; On the mobile terminal 12 that user holds, conventionally there is the song that user likes best and the most often listens, also just means that user wants the own possibility of singing these songs in audiovisual entertaining system larger.So, the expansion of the extensive expansion of Qu Ku and targeted and purpose all becomes possibility.
Further, the first communication unit 114 also comprises wired communication module and/or wireless communication module.The first communication unit 114 obtains song files from mobile terminal 12 or server 13 and specifically comprises by wired connection or wireless connections mode and obtain song files from mobile terminal 12 or Internet Server 13.Wireless connections mode wherein can comprise the wireless communication techniques such as GSM, LTE, 3G, 4G, WLAN, can certainly be any other wireless telecommunications new technology that can reach equally communication object occurring along with development in science and technology.
Received after song files by the first communication unit 114 in audiovisual terminals 11, the first processing unit 113 calls accompaniment extraction unit 111 and extract audio accompaniment from described song files.In the time that described song files is song audio frequency, accompaniment extraction unit 111 directly extracts audio accompaniment from song audio frequency.When described song files is while comprising the multimedia file of Voice & Video simultaneously, first the first processing unit 113 extracts song audio frequency from described multimedia file, and then calls accompaniment extraction unit 111 and extract audio accompaniment from described song audio frequency.Because obviously, the song that the overwhelming majority can be easily obtained from server 13 or mobile terminal 12 all has original singer, and the song audio frequency that has original singer is the demand that is difficult to meet Karaoke user, must do on its basis further processing, audio accompaniment extracted.The extraction of the audio accompaniment that accompaniment extraction unit 111 does specifically comprises removes original singer and promotes vocal accompaniment from song audio frequency.What removal original singer's technology was mainly utilized is the feature such as position distribution feature, the frequecy characteristic of original singer voice of original singer's voice in sound field, after catching and having determined these features, can to a great extent original singer's voice be separated and be removed from former bent audio frequency, reach the desirable effect that is suitable for karaoke accompaniment.In addition, in extracting, accompaniment sometimes also needs the processing of accompanying and promoting, likely because karaoke person is greater than singer to the demand of vocal accompaniment, also likely because accompaniment signal is also had to certain loss in the process of removing original singer's voice, so the extraction unit 111 of accompanying is where necessary also by the operation of accompanying and promoting.
After accompaniment extraction unit 111 has completed accompaniment extraction, audiovisual terminals 11 has been obtained desirable audio accompaniment, next the first processing unit 113 calls audiovisual synthesis unit 112 audio accompaniment and image video or image/video is synthesized to audio video document, and is stored in the some song storehouse of storage unit 115 or is stored in server 13 and with the form storage of online Streaming Media or use.
Because in this amusement process of sing karaoke, if only have audio frequency played, and on display screen without any image or video, will be very uninteresting and be short of recreational experience to user, also greatly weakened multimedia entertainment system superiority originally.So it is very necessary mixing video image for audio accompaniment, that is to say and need to synthesize a new accompaniment audio video document, audio-frequency information is wherein audio accompaniment but not original singer's song audio frequency.
When the original song files obtaining from mobile terminal 12 or server 13 is while comprising the multimedia file of video information, in new accompaniment audio video document, the source of video is the video information in this multimedia file; In the time that the original song files obtaining from mobile terminal 12 or server 13 is only song audio frequency, the MV(Music Video of the source of video this song that can be audiovisual terminals 11 obtain from mobile terminal 12 or server 13 in new accompaniment audio video document) or concert part or the corresponding vidclip of film primary sound of this song, the simple image video generating after its former attached audio-frequency information is peeled off.In the building-up process combining with audio accompaniment at video, also must, by the music progress reasonable butt-joint of audio accompaniment and song video so that the two coincide, avoid the mouth type situation different from the actual lyrics sentence that should occur in accompaniment music that occurs that in picture, singer sings.If cannot obtain MV or concert associated video to a song, also can directly call the video or the lantern slide that prestore and substitute.In certain embodiments, according to the classification difference in each district, call respectively different classes of video or lantern slide adaptive more to agree with the atmosphere in each district with it, ensure to play and result of use.For example adopting the acute paragraph of length is suitable, style is similar film and television, can also be even that scenic film paragraph, FLASH or the image/video that is made up of image are as lantern slide.
Further, audiovisual terminals 11 also comprises captions embedded unit 116; When the original song files obtaining from mobile terminal 12 or server 13 is, while comprising that the multimedia file of Audio and Video and this video have comprised caption information, not need to carry out captions embedding operation again; And in the time not comprising caption information in the video of original multimedia file or be song audio frequency from the original song files that mobile terminal 12 or server 13 obtain, need to carry out captions embedding operation, described captions are to call the first communication unit 114 from mobile terminal 12 or server 13 lyrics captions of synchronizeing with song files that obtain by the first processing unit 113.Because in karaoke process, user is difficult to ensure the lyrics of a first song are remembered tally in every detail, is many times the prompting that needs lyrics captions, is also necessary so embed captions in audio video document.
Obtain after captions, captions embedded unit 116 is embedded into described lyrics captions in audio video document.Certainly,, in the time embedding, also must ensure that the opportunity that every lyrics occur on video is all consistent with the opportunity that it occurs in former song, the accuracy of guarantee to the suggesting effect that user rose like this.Complete the audio video document of captions after embedding also by the some song storehouse being stored in storage unit 115 or be stored in server 13 and with form storage or the use of online Streaming Media.
Further, audiovisual terminals 11 also comprises sound processing unit 118, the first recording unit 117, plays driver element 119 and broadcast unit 1110.Mobile terminal 12 also comprises the second recording unit 121, the second processing unit 122 and the second communication unit 123.Complete after the making of audio video document, in the actual performance process of user, between mobile terminal 12 and audiovisual terminals 11, complete the mirror image of audio video document and sound by the information interaction of the first communication unit 114 and the second communication unit 123 synchronous; The first processing unit 113 call play driver element 119 in order to control broadcast unit 1110 on screen and sound equipment in playback of audio-visual file.When user starts to sing, the first processing unit 113 is transferred the first recording unit 117 and is received acoustic information, or the second processing unit 122 is transferred the second recording unit 121 and received acoustic information and by the second communication unit 123, described acoustic information is synchronized to audiovisual terminals 11.That is to say, user's Speech input can complete by first in audiovisual terminals 11 recording unit 117 as microphone, also can complete as microphone by the unit 121 of recording of second on mobile terminal 12.Particularly audiovisual terminals 11 number of microphone are limited, user has many people to participate under the demand of chorus simultaneously, and the microphone that utilizes every mobile terminal 12 all to have is the good solution to this problem.Subsequently, the first processing unit 113 calls sound processing unit 118 acoustic information receiving is processed, and call and play driver element 119 and control broadcast unit 1110 and play treated sound, user's song can be played back by sound equipment with together with sound in audio video document.
In present embodiment, mobile terminal 12 and audiovisual terminals 11 complete mirror image synchronously the Radio Transmission Technology based between the first communication unit 114 and the second communication unit 123 realize, described Radio Transmission Technology can comprise the main flow wireless data transmission technologys such as Airplay technology, DLNA technology, Miracast technology, WIDI technology, also can comprise other Radio Transmission Technologys.In fact, the mirror image of mobile terminal 12 and audiovisual terminals 11 synchronously can certainly be realized by wired connection, certainly wired connection will be short of than wireless connections in comfort level to some extent due to the existence of data line, while realization, the number of connectivity port is also had to requirement.
Referring to Fig. 2, is a kind of process flow diagram for the method in song storehouse of expanding in an embodiment of the present invention.Described method comprises step:
S20, obtain song files from mobile terminal or internet.
Described song files can be only that song audio frequency is that form is the file of the pure audio forms such as mp3, wav, wma, ape, flac, acc, apple lossless, can be also the multimedia file that simultaneously comprises audio-frequency information and video information.The source that in prior art is song in place of public amusement or the Kara OK songs storehouse of family expenses audio-video system is conventionally all more limited, if the some song storehouse in KTV may be mainly to depend on to copyright to be purchased and to buy song, the bent storehouse of family expenses audio-video system is more limited, can only lean on user oneself to buy the bent acquiescence Qu Ku that collects or depend on audio-video system of accompaniment, in so undoubtedly Qu Ku, the degree of enriching of song is quite short of, and is particularly difficult to meet the demand of the song that user issues recently to some.The technical scheme that the present invention proposes is exactly to obtain song from Internet Server 13 or user's mobile terminal 12, through one series of processes being made into into accompaniment audio video document.Chant music resource on internet is vast as the open sea, in all demands that meet user almost without any difficulty; On the mobile terminal 12 that user holds, conventionally there is the song that user likes best and the most often listens, also just means that user wants the own possibility of singing these songs in audiovisual entertaining system larger.So, the expansion of the extensive expansion of Qu Ku and targeted and purpose all becomes possibility.
Obtaining song files from mobile terminal 12 or server 13 specifically comprises by wired connection or wireless connections mode and obtains song files from mobile terminal 12 or Internet Server 13.Wireless connections mode wherein can comprise the wireless communication techniques such as GSM, LTE, 3G, 4G, WLAN, can certainly be any other wireless telecommunications new technology that can reach equally communication object occurring along with development in science and technology.
S21, from song files, extract audio accompaniment.
In certain embodiments, song files is the audiovisual multimedia file that comprises audio frequency, such as MV, film primary sound fragment etc., and in these embodiment, this step is isolated audio accompaniment track and original singer's voice track from the audio stream of audio video document; In other embodiment, song files is only pure audio file, and this step is isolated audio accompaniment and original singer's voice track from the audio stream of audio file.Concrete detachment process is as described below:
The first communication unit 114 has received after song files by the first communication unit 114 in audiovisual terminals 11, and the first processing unit 113 calls accompaniment extraction unit 111 and extract audio accompaniment from described song files.In the time that described song files is song audio frequency, accompaniment extraction unit 111 directly extracts audio accompaniment from song audio frequency.When described song files is while comprising the multimedia file of Voice & Video simultaneously, first the first processing unit 113 extracts song audio frequency from described multimedia file, and then calls accompaniment extraction unit 111 and extract audio accompaniment from described song audio frequency.Because obviously, the song that the overwhelming majority can be easily obtained from server 13 or mobile terminal 12 all has original singer, and the song audio frequency that has original singer is the demand that is difficult to meet Karaoke user, must do on its basis further processing, audio accompaniment extracted.The extraction of the audio accompaniment that accompaniment extraction unit 111 does specifically comprises removes original singer and promotes vocal accompaniment from song audio frequency.What removal original singer's technology was mainly utilized is the feature such as position distribution feature, the frequecy characteristic of original singer voice of original singer's voice in sound field, after catching and having determined these features, can to a great extent original singer's voice be separated and be removed from former bent audio frequency, reach the desirable effect that is suitable for karaoke accompaniment.In addition, in extracting, accompaniment sometimes also needs the processing of accompanying and promoting, likely because karaoke person is greater than singer to the demand of vocal accompaniment, also likely because accompaniment signal is also had to certain loss in the process of removing original singer's voice, so the extraction unit 111 of accompanying is where necessary also by the operation of accompanying and promoting.
The audio accompaniment extracting can form a new track; The original singer's voice separating can form another new track.In certain embodiments, the original singer's voice separating is abandoned, and only retains the track of audio accompaniment.In other embodiment, can retain this two tracks, for determining whether to play original singer's voice according to different requirements simultaneously.
S22, audio accompaniment and video or slide files are synthesized to audio video document.
After accompaniment extraction unit 111 has completed accompaniment extraction, audiovisual terminals 11 has been obtained desirable audio accompaniment, next the first processing unit 113 calls audiovisual synthesis unit 112 audio accompaniment and image video or image/video is synthesized to audio video document, and is stored in the some song storehouse of storage unit 115 or is stored in server 13 and with the form storage of online Streaming Media or use.
Because in this amusement process of sing karaoke, if only have audio frequency played, and on display screen without any image or video, will be very uninteresting and be short of recreational experience to user, also greatly weakened multimedia entertainment system superiority originally.So it is very necessary mixing video image for audio accompaniment, that is to say and need to synthesize a new accompaniment audio video document, audio-frequency information is wherein audio accompaniment but not original singer's song audio frequency.
When the original song files obtaining from mobile terminal 12 or server 13 is while comprising the multimedia file of video information, in new accompaniment audio video document, the source of video is the video information in this multimedia file; In this step, the video flowing of isolated audio accompaniment and original is synthetic; In the time that the original song files obtaining from mobile terminal 12 or server 13 is only song audio frequency, the MV(Music Video of the source of video this song that can be audiovisual terminals 11 obtain from mobile terminal 12 or server 13 in new accompaniment audio video document) or concert part or the corresponding vidclip of film primary sound of this song, the simple image video generating after its former attached audio-frequency information is peeled off.In the building-up process combining with audio accompaniment at video, also must, by the music progress reasonable butt-joint of audio accompaniment and song video so that the two coincide, avoid the mouth type situation different from the actual lyrics sentence that should occur in accompaniment music that occurs that in picture, singer sings.If cannot obtain MV or concert associated video to a song, also can directly call the video or the lantern slide that prestore and substitute.For example adopting the acute paragraph of length is suitable, style is similar film and television, can also be even that scenic film paragraph, FLASH or the image/video that is made up of image are as lantern slide.Adopting in the embodiment of lantern slide, can adopt independently slide files, also can adopt corresponding picture composition lantern slide in picture library to play.In certain embodiments, for different types of songs, in the picture library of different directories, choose picture, or in addition identification label of the picture in picture library, according to the difference of types of songs, select corresponding picture composition lantern slide with label.
Corresponding to the different embodiment that whether retain original singer's voice track, this step also can be taked different synthesis modes, if the original singer's voice separating is abandoned, only retains the track of audio accompaniment, and that only synthesizes new audio video document by audio accompaniment and video; If retain original singer's voice track and accompaniment track simultaneously, can original singer's voice track, accompaniment track and video be synthesized to new audio video document simultaneously, in these embodiment, while playing synthetic audio video document, can select according to demand only to play audio accompaniment track, or broadcast after will accompany in the time playing according to the instruction of receiving track and original singer's track audio mixing.
S23, obtain the lyrics captions of synchronizeing with song files from mobile terminal or internet, and lyrics captions are embedded to described audio video document.
In different embodiment, obtain lyrics captions and step that lyrics captions are embedded can be adjusted, for example in certain embodiments can be when audio stream and video flowing be synthesized to audio video document embedding lyrics captions.
S24, audio video document is stored in to local some song storehouse.
When the original song files obtaining from mobile terminal 12 or server 13 is, while comprising that the multimedia file of Audio and Video and this video have comprised caption information, not need to carry out captions embedding operation again; And in the time not comprising caption information in the video of original multimedia file or be song audio frequency from the original song files that mobile terminal 12 or server 13 obtain, need to carry out captions embedding operation to audio video document, described captions are to call the first communication unit 114 from mobile terminal 12 or server 13 lyrics captions of synchronizeing with song files that obtain by the first processing unit 113.Because in karaoke process, user is difficult to ensure the lyrics of a first song are remembered tally in every detail, is many times the prompting that needs lyrics captions, is also necessary so embed captions in audio video document.Obtain after captions, captions embedded unit 116 is embedded into described lyrics captions in audio video document.Certainly,, in the time embedding, also must ensure that the opportunity that every lyrics occur on video is all consistent with the opportunity that it occurs in former song, the accuracy of guarantee to the suggesting effect that user rose like this.In the present embodiment, complete captions and embed audio video document afterwards also by the some song storehouse being stored in storage unit 115; In other embodiments, complete that the audio video document of captions after embedding can also be stored in server 13 and with form storage or the use of online Streaming Media.
In certain embodiments, can adopt the embodiment different from step S24, for example, audio video document need not be stored, and synthetic audio video document is transmitted and play in the mode of Streaming Media.
S25, by wireless transmission method synchronous mobile terminal and audiovisual terminals.In certain embodiments, after audio video document after synthetic is carried out synchronously in mobile terminal and audiovisual terminals, in audio video document stores synchronized in mobile terminal box audiovisual terminals, then play, and in further embodiments, do not need the synchronous of file entirety, only in the time playing, carry out the synchronous of video pictures or audio accompaniment.In addition in certain embodiments, can not need synchronous mobile terminal box audiovisual terminals, only utilize audiovisual terminals to carry out playback of audio-visual file, therebetween in some embodiment, mobile terminal is as one of Mike source, recording audio, and mobile phone recording is transferred to audiovisual terminals processes.
S26, playback of audio-visual file.
As described in step S22, the synthetic audio video document of step S22 only has accompaniment track, and while broadcasting so, audio-frequency unit is only play accompaniment.If the audio video document providing in certain embodiments has accompaniment track and original singer's voice track simultaneously, can, according to the difference of real needs in different embodiment, carry out different broadcasting schemes, do not play original singer's voice track as only play accompaniment track; Or in other embodiment, due to singer's being unfamiliar with song, may in playing accompaniment track, play original singer's voice track and sing tune with prompting, so just can adjust original singer's voice track and the intensity of sound of accompaniment track respectively according to user instruction, to meet different user volume requirement with original singer's voice for accompaniment.
S27, receive sound from mobile terminal or audiovisual terminals.
S28, processing are also play described sound.
Complete after the making of audio video document, in the actual performance process of user, between mobile terminal 12 and audiovisual terminals 11, complete the mirror image of audio video document and sound by the information interaction of the first communication unit 114 and the second communication unit 123 synchronous; The first processing unit 113 call play driver element 119 in order to control broadcast unit 1110 on screen and sound equipment in playback of audio-visual file.When user starts to sing, the first processing unit 113 is transferred the first recording unit 117 and is received acoustic information, or the second processing unit 122 is transferred the second recording unit 121 and received acoustic information and by the second communication unit 123, described acoustic information is synchronized to audiovisual terminals 11.That is to say, user's Speech input can complete by first in audiovisual terminals 11 recording unit 117 as microphone, also can complete as microphone by the unit 121 of recording of second on mobile terminal 12.Particularly audiovisual terminals 11 number of microphone are limited, user has many people to participate under the demand of chorus simultaneously, and the microphone that utilizes every mobile terminal 12 all to have is the good solution to this problem.Subsequently, the first processing unit 113 calls sound processing unit 118 acoustic information receiving is processed, and call and play driver element 119 and control broadcast unit 1110 and play treated sound, user's song can be played back by sound equipment with together with sound in audio video document.
In present embodiment, mobile terminal 12 and audiovisual terminals 11 complete mirror image synchronously the Radio Transmission Technology based between the first communication unit 114 and the second communication unit 123 realize, described Radio Transmission Technology can comprise the main flow wireless data transmission technologys such as Airplay technology, DLNA technology, Miracast technology, WIDI technology, also can comprise other Radio Transmission Technologys.In fact, the mirror image of mobile terminal 12 and audiovisual terminals 11 synchronously can certainly be realized by wired connection, certainly wired connection will be short of than wireless connections in comfort level to some extent due to the existence of data line, while realization, the number of connectivity port is also had to requirement.
The foregoing is only embodiments of the invention; not thereby limit the scope of the claims of the present invention; every equivalent structure or conversion of equivalent flow process that utilizes instructions of the present invention and accompanying drawing content to do; or be directly or indirectly used in other relevant technical fields, be all in like manner included in scope of patent protection of the present invention.