CN103886881B - A kind of method and its system of extension point library - Google Patents
A kind of method and its system of extension point library Download PDFInfo
- Publication number
- CN103886881B CN103886881B CN201410147686.7A CN201410147686A CN103886881B CN 103886881 B CN103886881 B CN 103886881B CN 201410147686 A CN201410147686 A CN 201410147686A CN 103886881 B CN103886881 B CN 103886881B
- Authority
- CN
- China
- Prior art keywords
- audio
- accompaniment
- song
- mobile terminal
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Reverberation, Karaoke And Other Acoustics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present invention provides a kind of methods for expanding point library, including step：Song files are obtained from mobile terminal or internet；Audio accompaniment is extracted from song files；Audio accompaniment and video or slide files are synthesized into audio video document；The lyrics subtitle with audio sync is obtained from mobile terminal or internet, and lyrics subtitle is embedded in the audio video document；Audio video document is stored in local point library；Pass through wireless transmission method synchronous mobile terminal and audiovisual terminals；Playback of audio-visual file；Sound is received from mobile terminal or audiovisual terminals；It handles and plays the sound.The present invention also provides a kind of corresponding systems for expanding point library.Beneficial effects of the present invention are：It makes full use of and local requesting song music library is expanded by the huge number of songs that internet and mobile terminal can obtain, and produce the accompaniment audio video document that can fully meet user demand.
Description
Technical field
The present invention relates to the audiovisual control in public entertainment or private home entertainment place and management domain, more particularly to a kind of extension
The method and its system of point library.
Background technology
No matter the main source of the song in place of public amusement such as KTV or private home audiovisual system is to version at present
It is bought commercially available from power, due to fund limitation, flow complexity and time difference, the usual song of library in these entertainment systems is not rich enough
Rich, new song update is also not prompt enough, is difficult often to meet user's demand.
Invention content
The technical solution used in the present invention is：
A method of extension point library, including step：
Song files are obtained from mobile terminal or internet；
Audio accompaniment is extracted from song files；
Audio accompaniment and video or slide files are synthesized into audio video document.
Further, the method for extension point library further includes step：From mobile terminal or internet obtain with
The lyrics subtitle that song files synchronize, and lyrics subtitle is embedded in the audio video document.
Further, in the method for extension point library, the song files include song audio or multimedia
File；Described from audio accompaniment is extracted in song files includes removing original singer from song audio or promoting vocal accompaniment, or from more matchmakers
Song audio is extracted in body file and is removed original singer from song audio or is promoted vocal accompaniment.
Further, in the method for extension point library, audio accompaniment is being synthesized with video or slide files
To further include that mirror image synchronization performs in a radio or TV programme step after audio video document, specifically include：
Pass through wireless transmission method synchronous mobile terminal and audiovisual terminals；
Playback of audio-visual file；
Sound is received from mobile terminal or audiovisual terminals；
It handles and plays the sound.
Further, in the method for the described extension point library, the wireless transmission method include Airplay technologies,
DLNA technologies, Miracast technologies or WIDI technologies.
Further, in the method for extension point library, song files tool is obtained from mobile terminal or internet
Body includes：By wired connection or wireless connection mode song files are obtained from mobile terminal or internet.
Further, in the method for extension point library, obtaining song files from mobile terminal or internet is
Audio video document or pure audio files；
When being audio video document from mobile terminal or internet acquisition song files, by audio accompaniment and video or magic lantern text
It includes step that part, which synthesizes audio video document,：It is audio video document by audio accompaniment and the Video Composition in former audio video document；
When being pure audio files from mobile terminal or internet acquisition song files, by audio accompaniment and video or magic lantern
File synthesis is that audio video document includes step：By web search video file compatible with song files, and by accompaniment tone
Frequency is audio video document with the Video Composition in video file, or audio accompaniment and preset video or magic lantern is synthesized new regard
Listen file.
A kind of system of extension point library, including audiovisual terminals and server or mobile terminal；
Audiovisual terminals include accompaniment extraction unit, audiovisual synthesis unit, first processing units, the first communication unit and storage
Unit；
Server includes public server or private services device；
First processing units call the first communication unit to obtain song files from mobile terminal or server, and accompaniment is called to carry
It takes unit to extract audio accompaniment from the song files, calls audiovisual synthesis unit by audio accompaniment and video or slide files
Synthesize audio video document.
Further, in the system of extension point library, audiovisual terminals further include subtitle embedded unit；
First processing units call the first communication unit to obtain the song synchronous with song files from mobile terminal or server
Word subtitle, and call subtitle embedded unit that the lyrics subtitle is embedded into audio video document.
Further, in the system of extension point library, the song files include song audio or multimedia
File；
Accompaniment extraction unit is carried from removal original singer in song audio or promotion vocal accompaniment or processing unit from multimedia file
It takes song audio and extraction unit of accompanying removes original singer from song audio or promotes vocal accompaniment.
Further, in the system of extension point library, audiovisual terminals include sound processing unit, the first recording
Unit plays driving unit and broadcast unit；Mobile terminal includes that the second recoding unit, second processing unit and the second communication are single
Member；
After audio accompaniment and video or slide files are synthesized audio video document by audiovisual synthesis unit, the first communication is single
Member and the second communication unit between mobile terminal and audiovisual terminals for passing through wireless transmission method audio-video synchronization file；
First processing units, which are called, plays driving unit to control broadcast unit playback of audio-visual file；
First processing units transfer the first recoding unit reception acoustic information or second processing unit transfers the second recording list
Member receives acoustic information and the acoustic information is transmitted to audiovisual terminals by the second communication unit；
First processing units call sound processing unit to handle the acoustic information, and broadcasting driving unit control is called to broadcast
It puts unit and plays processed sound.
Further, in the system of the described extension point library, the wireless transmission method include Airplay technologies,
DLNA technologies, Miracast technologies or WIDI technologies.
Further, in the system of extension point library, the first communication unit includes wired communication module or nothing
Line communication module；First communication unit obtains song files from mobile terminal or internet and specifically includes：By wired connection or
Radio connection obtains song files from mobile terminal or internet.
Further, in the system of extension point library, obtaining song files from mobile terminal or server is
Audio video document or pure audio files；
When from mobile terminal or server, to obtain song files be audio video document, audiovisual synthesis unit by audio accompaniment with
Video Composition in former audio video document is audio video document；
When being pure audio files from mobile terminal or server acquisition song files, first processing units are searched by network
Rope video file compatible with song files, audiovisual synthesis unit by the Video Composition in audio accompaniment and video file be regarding
Listen file；Or audio accompaniment and preset video or magic lantern are synthesized new audio video document by audiovisual synthesis unit.
By taking above-mentioned technical proposal, what the present invention obtained has the beneficial effect that：It makes full use of internet and intelligent mobile
The powerful storage capacity of terminal and calculation processing ability to multimedia file, produce and meet user demand to the full extent
For the accompaniment audio video document of Karaoke, the ability for expanding Qu Ku in public or private multimedia entertainment system is fully improved.
Description of the drawings
Fig. 1 is a kind of high-level schematic functional block diagram of system that expanding point library in an embodiment of the present invention；
Fig. 2 is a kind of flow chart of method that expanding point library in an embodiment of the present invention.
Label declaration：
11- audiovisual terminals
111- accompaniment extraction units
112- audiovisual synthesis units
113- first processing units
The first communication units of 114-
115- storage units
116- subtitle embedded units
The first recoding units of 117-
118- sound processing units
119- plays driving unit
1110- broadcast units
12- mobile terminals
The second recoding units of 121-
122- second processing units
The second communication units of 123-
13- servers
131- public servers
132- private services devices
Specific implementation mode
In order to describe the technical content, the structural feature, the achieved object and the effect of this invention in detail, below in conjunction with embodiment
And attached drawing is coordinated to be explained in detail.
Referring to Fig. 1, for a kind of high-level schematic functional block diagram of the system of extension point library in an embodiment of the present invention；
Dotted line between representing two function modules that dotted line connects there is information to transmit relationship in figure.
The system of extension point library described in present embodiment includes audiovisual terminals 11 and server 13.Wherein, audiovisual
Terminal 11 includes that first processing units 113, the first communication unit 114, storage unit 115, accompaniment extraction unit 111 and audiovisual are closed
At unit 112.First processing units 113 are for calling the first communication unit 114 to obtain song files from server 13.Another
In embodiment, the system also includes mobile terminals 12, and in this embodiment, first processing units 113 call first to lead to
It interrogates unit 114 and obtains song files from mobile terminal 12.
The song files can be only that song audio i.e. format is mp3, wav, wma, ape, flac, acc, apple
The file of the pure audios form such as lossless, the multimedia file that can also be while including audio-frequency information and video information.Institute
It may include the intelligent terminals such as smart mobile phone, tablet computer, PDA, ipod, MP3 player, MP4 players to state mobile terminal 12.
The source of song is usually all either in the Kara OK songs library of place of public amusement or household audio-video system in the prior art
Than relatively limited, song is bought commercially available from copyright as the point library in KTV may be depended primarily on, and the song of household audio-video system
Library is then more limited, and user oneself can only be leaned on to buy the bent collection of accompaniment or the acquiescence Qu Ku dependent on audio-video system, undoubtedly such
The abundant degree of song is quite short of in Qu Ku, is especially difficult to meet demand of the user to some songs issued recently.This
The technical solution that invention proposes is exactly the movement from public server 131 or private services device 132 or user on internet
Song is obtained in terminal 12, by being made into one series of processes for audio video document of accompanying.Song sound on internet
Happy resource is vast as the open sea, almost without any difficulty in all demands for meet user；And the mobile terminal 12 that user is held
On then usually have the song that user most likes and most often listens, also mean that user wants oneself and sung in audiovisual entertaining system
The possibility of these songs is larger.So, Qu Ku it is extensive expand and targetedly and the expansion of purpose all become can
Energy.
Further, the first communication unit 114 further includes wire communication module and/or wireless communication module.First communication
Unit 114 from mobile terminal 12 or server 13 obtain song files specifically include by wired connection or wireless connection mode from
Mobile terminal 12 or Internet Server 13 obtain song files.Radio connection therein may include GSM, LTE, 3G,
The wireless communication techniques such as 4G, WLAN, naturally it is also possible to be any other occur with development in science and technology be equally reached letter
The wireless telecommunications new technology of breath transmission purpose.
After audiovisual terminals 11 have received song files by the first communication unit 114, first processing units 113 are called
Accompaniment extraction unit 111 extracts audio accompaniment from the song files.When the song files are song audio, accompaniment carries
Unit 111 is taken directly to extract audio accompaniment from song audio.When the song files are while including the more of audio and video
When media file, first processing units 113 extract song audio from the multimedia file first, then recall accompaniment and carry
Unit 111 is taken to extract audio accompaniment from the song audio.Because it will be apparent that the overwhelming majority can easily from server 13 or
The song obtained on person's mobile terminal 12 all has original singer, and it is difficult to meet Karaoke user to have the song audio of original singer to be
Demand, it is necessary to be further processed on its basis, audio accompaniment is extracted.The companion that accompaniment extraction unit 111 is done
The extraction for playing audio specifically includes the removal original singer from song audio and promotes vocal accompaniment.What the technology of removal original singer mainly utilized
It is position distribution feature of original singer's voice in sound field, the features such as frequecy characteristic of original singer's voice, is capturing and these are determined
After feature, can largely original singer's voice be detached and be removed from former bent audio, reached and be preferably suitable for OK a karaoke club
OK sings the effect of accompaniment.In addition, also needing to carry out the processing of vocal accompaniment promotion sometimes in accompaniment is extracted, it is possible to because of OK a karaoke club
Demand of the OK singers to vocal accompaniment is more than singer, it is also possible to because also having to accompaniment signal during removing original singer's voice
Certain loss, so accompaniment extraction unit 111 will also carry out the operation of vocal accompaniment promotion if necessary.
After accompaniment extraction unit 111 completes accompaniment extraction, audiovisual terminals 11 obtain ideal audio accompaniment, connect
First processing units of getting off 113 are called audiovisual synthesis unit 112 to synthesize audio accompaniment with image video or image/video and are regarded
File is listened, and is stored in the point library of storage unit 115 or is stored in server 13 and is deposited in the form of online Streaming Media
Storage uses.
Because during this amusement of sing karaoke, if only audio is played, and it is not any on a display screen
If image or video, it will be very uninteresting to user and be short of recreational experience, also largely reduced multimedia recreation system
The superiority of system script.So it is very necessary to mix video image for audio accompaniment, that is to say, that need synthesis one new
Accompaniment audio video document, audio-frequency information therein be audio accompaniment rather than original singer's song audio.
When the original song files obtained from mobile terminal 12 or server 13 are the multimedia file for including video information
When, the source of video is the video information in the multimedia file in new accompaniment audio video document；When original from mobile terminal
12 or the song files that obtain of server 13 when being only song audio, the source of video can be in new accompaniment audio video document
The MV for the song that audiovisual terminals 11 are obtained from mobile terminal 12 or server 13（Music Video）Or song in concert
Part or movie soundtrack corresponding to vidclip, the simple image that its former attached audio-frequency information stripping generates later is regarded
Frequently.In video in the building-up process that audio accompaniment is combined, it is necessary to close the music progress of audio accompaniment and song-video
Reason is docked so that the two is coincide, and avoids the occurrence of the lyrics that should actually occur in the nozzle type and accompaniment music that singer in picture sings
The different situation of sentence.If MV or concert associated video can not be obtained to a song, it can also directly invoke and prestore
Video or lantern slide substitute.In certain embodiments, according to the classification in each area difference, different classes of video or unreal is called respectively
Lamp piece is adapted to therewith more to agree with the atmosphere in each area, ensures broadcasting and using effect.It is suitable for example, by using length, style is similar
Film and television play paragraph, or even can also be scenic film paragraph, FLASH or the image/video such as lantern slide being made of image.
Further, audiovisual terminals 11 further include subtitle embedded unit 116；It is obtained when from mobile terminal 12 or server 13
Original song file be include video and audio multimedia file and the video in when including caption information, do not need
Subtitle embedding operation is carried out again；And when original multimedia file video in include caption information or from mobile terminal 12 or clothes
When the original song file that business device 13 obtains is song audio, need to carry out subtitle embedding operation, the subtitle is by first
Manage the lyrics synchronous with song files that unit 113 calls the first communication unit 114 to be obtained from mobile terminal 12 or server 13
Subtitle.Because during karaoke, user is many times it is difficult to ensure that remember the lyrics of a first song tally in every detail
The prompt of lyrics subtitle is needed, so embedded subtitle is also necessary in audio video document.
After obtaining subtitle, the lyrics subtitle is embedded into audio video document by subtitle embedded unit 116.Certainly, in insertion
When, it is also necessary to ensure that the opportunity that every lyrics occur on video is all consistent with the opportunity that it occurs in former song, such ability
Ensure the accuracy of the suggesting effect risen to user.Storage list will be also stored in by completing the audio video document after subtitle is embedded in
In point library in member 115 or it is stored in server 13 and is stored or used in the form of online Streaming Media.
Further, audiovisual terminals 11 further include sound processing unit 118, the first recoding unit 117, play driving unit
119 and broadcast unit 1110.Mobile terminal 12 further includes the second recoding unit 121, the communication list of second processing unit 122 and second
Member 123.After completing the making of audio video document, during the practical performance of user, between mobile terminal 12 and audiovisual terminals 11
The mirror image synchronization of audio video document and sound is completed by the information exchange of the first communication unit 114 and the second communication unit 123；The
One processing unit 113 call play driving unit 119 to control broadcast unit 1110 on the screen with playback of audio-visual in sound equipment
File.When user starts to sing, first processing units 113 transfer the first recoding unit 117 and receive acoustic information or second processing
Unit 122 transfers the second recoding unit 121 and receives acoustic information and synchronized the acoustic information by the second communication unit 123
To audiovisual terminals 11.That is, the voice input of user can pass through the first recoding unit 117 such as wheat in audiovisual terminals 11
Gram wind is completed, and can also be passed through such as microphone of the second recoding unit 121 on mobile terminal 12 and be completed.Especially in audiovisual terminals
11 number of microphone are limited and user has under the demand that more people simultaneously participate in chorus, all have using every mobile terminal 12
Microphone is the good solution to this problem.Then, first processing units 113 call sound processing unit 118 to dock
The acoustic information received is handled, and is called broadcasting driving unit 119 to control broadcast unit 1110 and played processed sound,
The song of user can be played back together with the sound in audio video document by sound equipment.
In present embodiment, mobile terminal 12 and the completion of audiovisual terminals 11 mirror image synchronization are to be based on the first communication unit 114
Radio Transmission Technology between the second communication unit 123 and realize, the Radio Transmission Technology may include Airplay skills
The mainstreams wireless data transmission technologys such as art, DLNA technologies, Miracast technologies, WIDI technologies can also include other wireless biographies
Transferring technology.In fact, the mirror image synchronization of mobile terminal 12 and audiovisual terminals 11 can certainly be realized by wired connection, when
Right wired connection due to data line presence and compared with being wirelessly connected and to be short of in comfort level, to connecting pin when realization
The number of mouth also requires.
Referring to Fig. 2, for a kind of flow chart of method that expanding point library in an embodiment of the present invention.The method
Including step：
S20, song files are obtained from mobile terminal or internet.
The song files can be only that song audio i.e. format is mp3, wav, wma, ape, flac, acc, apple
The file of the pure audios form such as lossless, the multimedia file that can also be while including audio-frequency information and video information.It is existing
There is in technology the source of song in the either Kara OK songs library of place of public amusement or household audio-video system usually all compare
It is relatively limited, song is bought commercially available from copyright as the point library in KTV may be depended primarily on, and the Qu Ku of household audio-video system
It is then more limited, user oneself can only be leaned on to buy the bent collection of accompaniment or the acquiescence Qu Ku dependent on audio-video system, it is undoubtedly such bent
The abundant degree of song is quite short of in library, is especially difficult to meet demand of the user to some songs issued recently.This hair
The technical solution of bright proposition is exactly to obtain song from Internet Server 13 or the mobile terminal of user 12, by one
Series of processes is made into as audio video document of accompanying.Chant music resource on internet is vast as the open sea, is meeting user's
Almost without any difficulty in all demands；And then usually have on the mobile terminal 12 that user is held user most like and most often
The song listened, also mean that user want oneself to sing in audiovisual entertaining system these songs possibility it is larger.So,
The extensive expansion and targeted and purpose expansion of Qu Ku all becomes possibility.
Song files are obtained from mobile terminal 12 or server 13 to specifically include through wired connection or wireless connection mode
Song files are obtained from mobile terminal 12 or Internet Server 13.Radio connection therein may include GSM, LTE,
The wireless communication techniques such as 3G, 4G, WLAN, naturally it is also possible to be any other being equally reached of occurring with development in science and technology
Information transmits the wireless telecommunications new technology of purpose.
S21, audio accompaniment is extracted from song files.
In certain embodiments, song files are the audio/visual multimedia file comprising audio, such as MV, movie soundtrack segment
Deng in these embodiments, this step isolates audio accompaniment track and original singer's voice track from the audio stream of audio video document；
In other embodiment, song files are only pure audio files, this step isolates companion from the audio stream of audio file
Play audio and original singer's voice track.Specific separation process is as described below：
First communication unit 114 is after audiovisual terminals 11 have received song files by the first communication unit 114, and first
Processing unit 113 calls accompaniment extraction unit 111 to extract audio accompaniment from the song files.When the song files are song
When bent audio, accompaniment extraction unit 111 directly extracts audio accompaniment from song audio.When the song files are while including
When the multimedia file of audio and video, first processing units 113 extract song audio from the multimedia file first, so
After recall accompaniment extraction unit 111 extract audio accompaniment from the song audio.Because it will be apparent that the overwhelming majority can be light
The song easily obtained from server 13 or mobile terminal 12 all has original singer, and it is difficult full to have the song audio of original singer to be
The demand of foot Karaoke user, it is necessary to be further processed on its basis, audio accompaniment is extracted.Accompaniment extraction is single
The extraction for the audio accompaniment that member 111 is done is specifically included to remove original singer from song audio and promoted and be accompanied.Remove original singer's
What technology mainly utilized is position distribution feature of original singer's voice in sound field, the features such as frequecy characteristic of original singer's voice, is being caught
After catching and determining these features, can largely original singer's voice be detached and be removed from former bent audio, reached
The ideal effect suitable for karaoke accompaniment.In addition, also need to carry out the processing of vocal accompaniment promotion sometimes in accompaniment is extracted,
It is possible that because demand of the karaoke person to vocal accompaniment is more than singer, it is also possible to because during removing original singer's voice
Also there is certain loss to accompaniment signal, so accompaniment extraction unit 111 will also carry out the operation of vocal accompaniment promotion if necessary.
The audio accompaniment extracted can form a new track；The original singer's voice separated can form another newly
Track.In certain embodiments, the original singer's voice separated is abandoned, and only retains the track of audio accompaniment.In other
In embodiment, this two tracks can be retained simultaneously, original singer's voice is played for deciding whether according to different requirements.
S22, audio accompaniment and video or slide files are synthesized into audio video document.
After accompaniment extraction unit 111 completes accompaniment extraction, audiovisual terminals 11 obtain ideal audio accompaniment, connect
First processing units of getting off 113 are called audiovisual synthesis unit 112 to synthesize audio accompaniment with image video or image/video and are regarded
File is listened, and is stored in the point library of storage unit 115 or is stored in server 13 and is deposited in the form of online Streaming Media
Storage uses.
Because during this amusement of sing karaoke, if only audio is played, and it is not any on a display screen
If image or video, it will be very uninteresting to user and be short of recreational experience, also largely reduced multimedia recreation system
The superiority of system script.So it is very necessary to mix video image for audio accompaniment, that is to say, that need synthesis one new
Accompaniment audio video document, audio-frequency information therein be audio accompaniment rather than original singer's song audio.
When the original song files obtained from mobile terminal 12 or server 13 are the multimedia file for including video information
When, the source of video is the video information in the multimedia file in new accompaniment audio video document；In this step, it will detach
The audio accompaniment gone out is synthesized with the video flowing of original；When the original song text obtained from mobile terminal 12 or server 13
When part is only song audio, in new accompaniment audio video document the source of video can be audiovisual terminals 11 from mobile terminal 12 or
The MV for the song that server 13 obtains（Music Video）Or in concert corresponding to the part of the song or movie soundtrack
Its former attached audio-frequency information is removed the simple image video generated later by vidclip.It is mutually tied with audio accompaniment in video
In the building-up process of conjunction, it is necessary to by the music progress reasonable butt-joint of audio accompaniment and song-video so that the two is coincide, avoid
There is the nozzle type of singer's singing in the picture situation different from the lyrics sentence that should actually occur in accompaniment music.If to one
Song can not obtain MV or concert associated video, can also directly invoke the video to prestore or lantern slide substitutes.Such as it adopts
With the film and television play paragraph that length is suitable, style is similar, or even it can also be scenic film paragraph, FLASH or be made of image
Image/video such as lantern slide.In the embodiment using lantern slide, independent slide files may be used, figure can also be used
Corresponding picture composition lantern slide plays out in valut.In certain embodiments, for different types of songs, in different directories
Picture library in choose picture, or label is identified to the picture in picture library, according to the difference of types of songs, with label
To select corresponding picture to form lantern slide.
Correspond to whether that the different embodiments for retaining original singer's voice track, this step can also take different synthesis sides
Formula only retains the track of audio accompaniment if the original singer's voice separated is abandoned, and audio accompaniment and Video Composition are only new by that
Audio video document；If retain simultaneously original singer's voice track with accompaniment track, can simultaneously by original singer's voice track, accompaniment track with
Video Composition is new audio video document, in these embodiments, when playing the audio video document of synthesis, can select only to broadcast according to demand
Audio accompaniment track is put, or will be broadcasted after accompaniment track and original singer's track audio mixing according to the instruction received when playing.
S23, the lyrics subtitle synchronous with song files is obtained from mobile terminal or internet, and lyrics subtitle is embedded in institute
State audio video document.
In various embodiments, it obtains lyrics subtitle and can adjust the step that lyrics subtitle is embedded in, such as
In some embodiments can while audio stream and video flowing are synthesized audio video document embedding lyrics subtitle.
S24, audio video document is stored in local point library.
It includes video and the multimedia text of audio to be when the original song file obtained from mobile terminal 12 or server 13
When including caption information in part and the video, subtitle embedding operation need not be carried out again；And when original multimedia file
When the original song file obtained including caption information or from mobile terminal 12 or server 13 in video is song audio, need
Will to audio video document carry out subtitle embedding operation, the subtitle be by first processing units 113 call the first communication unit 114 from
The lyrics subtitle synchronous with song files that mobile terminal 12 or server 13 obtain.Because during karaoke, use
Family is many times the prompt for needing lyrics subtitle it is difficult to ensure that the lyrics of song first to one are remembered tally in every detail, thus regarding
It is also necessary to listen embedded subtitle in file.After obtaining subtitle, the lyrics subtitle is embedded by subtitle embedded unit 116
In audio video document.Certainly, when embedded, it is also necessary to ensure that the opportunity that every lyrics occur on video all goes out with it in former song
Existing opportunity is consistent, just can guarantee the accuracy of the suggesting effect risen to user in this way.In the present embodiment, subtitle is completed
Audio video document after insertion also will be in the point library that be stored in storage unit 115；In other embodiments, it completes
Audio video document after subtitle insertion can also be stored in server 13 and be stored or be used in the form of online Streaming Media.
In some embodiments it is possible to using the embodiment different from step S24, such as without depositing audio video document
Storage, and the audio video document of synthesis is transmitted and played in the streaming media.
S25, pass through wireless transmission method synchronous mobile terminal and audiovisual terminals.It in certain embodiments, will be after synthesis
After audio video document synchronizes in mobile terminal and audiovisual terminals, i.e., is synchronized in audio video document and be stored in mobile terminal box and regard
Terminal is listened, is then played out, and in further embodiments, the synchronization of file entirety is not needed, is only regarded when playing
The synchronization of frequency picture or audio accompaniment.In addition in some embodiments it is possible to not need synchronous mobile terminal box audiovisual end
End, plays out audio video document, therebetween in some embodiments, mobile terminal is as Mike source just with audiovisual terminals
One of, recording audio, and mobile phone recording is transferred to audiovisual terminals and is processed.
S26, playback of audio-visual file.
As described in step S22, the audio video document of step S22 synthesis is only accompanied track, then audio-frequency unit is only when playing
Play accompaniment.It, can be with if the audio video document that provides in certain embodiments while there is accompaniment track and original singer's voice track
According to the difference of specific requirements in different embodiments, different broadcasting schemes is executed, it is former without playing such as only to play accompaniment track
Sing voice track；Or in other embodiments, since singer is unfamiliar with song, it may be necessary to play accompaniment tone
Original singer's voice track is played while rail to prompt to sing tune, then can be according to user instruction respectively to original singer's voice sound
The intensity of sound of rail and accompaniment track is adjusted, to meet volume requirement of the different user for accompaniment and original singer's voice.
S27, sound is received from mobile terminal or audiovisual terminals.
S28, processing simultaneously play the sound.
After completing the making of audio video document, user is practical sing during, mobile terminal 12 and audiovisual terminals 11 it
Between by the information exchange of the first communication unit 114 and the second communication unit 123 complete audio video document and sound mirror image synchronization；
First processing units 113 are called broadcasting driving unit 119 and are regarded on the screen with broadcasting in sound equipment to control broadcast unit 1110
Listen file.When user starts to sing, first processing units 113 are transferred the first recoding unit 117 and are received at acoustic information or second
Reason unit 122 transfers the second recoding unit 121 and receives acoustic information and by the second communication unit 123 that the acoustic information is same
It walks to audiovisual terminals 11.That is, the voice input of user can be by the first recoding unit 117 in audiovisual terminals 11 such as
Microphone is completed, and can also be completed by such as microphone of the second recoding unit 121 on mobile terminal 12.Especially at audiovisual end
It holds that 11 number of microphone are limited and user has under the demand that more people simultaneously participate in chorus, all has using every mobile terminal 12
Microphone be good solution to this problem.Then, first processing units 113 call sound processing unit 118 right
The acoustic information received is handled, and is called broadcasting driving unit 119 to control broadcast unit 1110 and played processed sound
The song of sound, user can be played back together with the sound in audio video document by sound equipment.
In present embodiment, mobile terminal 12 and the completion of audiovisual terminals 11 mirror image synchronization are to be based on the first communication unit 114
Radio Transmission Technology between the second communication unit 123 and realize, the Radio Transmission Technology may include Airplay skills
The mainstreams wireless data transmission technologys such as art, DLNA technologies, Miracast technologies, WIDI technologies can also include other wireless biographies
Transferring technology.In fact, the mirror image synchronization of mobile terminal 12 and audiovisual terminals 11 can certainly be realized by wired connection, when
Right wired connection due to data line presence and compared with being wirelessly connected and to be short of in comfort level, to connecting pin when realization
The number of mouth also requires.
Example the above is only the implementation of the present invention is not intended to limit the scope of the invention, every to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (8)
1. a kind of method of extension point library, which is characterized in that including step：
Audiovisual terminals obtain song files from mobile terminal or internet；
Audiovisual terminals extract audio accompaniment from song files；
Audio accompaniment and video or slide files are synthesized audio video document by audiovisual terminals；
The song files include song audio or multimedia file；The audio accompaniment that extracted from song files includes from song
Original singer is removed in bent audio or promotes vocal accompaniment, or original singer is removed from extraction song audio in multimedia file and from song audio
Or promote vocal accompaniment；
It is audio video document or pure audio files to obtain song files from mobile terminal or internet；
When being audio video document from mobile terminal or internet acquisition song files, audio accompaniment and video or slide files are closed
Include step as audio video document：It is audio video document by audio accompaniment and the Video Composition in former audio video document；
When being pure audio files from mobile terminal or internet acquisition song files, by audio accompaniment and video or slide files
It includes step to synthesize audio video document：By web search video file compatible with song files, and by audio accompaniment with
Video Composition in video file is audio video document, or audio accompaniment and preset video or magic lantern are synthesized to new audiovisual text
Part；
Pass through wireless transmission method synchronous mobile terminal and audiovisual terminals；
Audiovisual terminals include first processing units, play driving unit and broadcast unit, and first processing units, which are called, plays driving
Unit to control broadcast unit on the screen with playback of audio-visual file in sound equipment；
Audiovisual terminals receive sound from mobile terminal；
Audiovisual terminals handle and play the sound.
2. the method for extension point library as described in claim 1, which is characterized in that further include step：
The lyrics subtitle synchronous with song files is obtained from mobile terminal or internet, and lyrics subtitle is embedded in the audiovisual text
Part.
3. the method for extension point library as described in claim 1, which is characterized in that the wireless transmission method includes
Airplay technologies, DLNA technologies, Miracast technologies or WIDI technologies.
4. the method for extension point library as claimed in claim 1 or 2, which is characterized in that obtained from mobile terminal or internet
Song files are taken to specifically include：By wired connection or wireless connection mode song files are obtained from mobile terminal or internet.
5. a kind of system of extension point library, which is characterized in that including audiovisual terminals and server or mobile terminal；
Audiovisual terminals include that accompaniment extraction unit, audiovisual synthesis unit, first processing units, the first communication unit and storage are single
Member；
Server includes public server or private services device；
First processing units call the first communication unit to obtain song files from mobile terminal or server, call accompaniment extraction single
Member extracts audio accompaniment from the song files, and audiovisual synthesis unit is called to synthesize audio accompaniment with video or slide files
For audio video document；
The song files include song audio or multimedia file；
Accompaniment extraction unit extracts song from removal original singer in song audio or promotion vocal accompaniment or processing unit from multimedia file
Bent audio and extraction unit of accompanying remove original singer from song audio or promote vocal accompaniment；
It is audio video document or pure audio files to obtain song files from mobile terminal or server；
When being audio video document from mobile terminal or server acquisition song files, audiovisual synthesis unit regards audio accompaniment and original
It is audio video document to listen the Video Composition in file；
When from mobile terminal or server, to obtain song files be pure audio files, first processing units by web search with
Video Composition in audio accompaniment and video file is audiovisual text by the compatible video file of song files, audiovisual synthesis unit
Part；Or audio accompaniment and preset video or magic lantern are synthesized new audio video document by audiovisual synthesis unit；
After audio accompaniment and video or slide files are synthesized audio video document by audiovisual synthesis unit, the first communication unit with
Second communication unit between mobile terminal and audiovisual terminals for passing through wireless transmission method audio-video synchronization file；
Audiovisual terminals include first processing units, play driving unit and broadcast unit, and first processing units, which are called, plays driving
Unit to control broadcast unit on the screen with playback of audio-visual file in sound equipment；Second processing unit transfers the second recoding unit
It receives acoustic information and the acoustic information is transmitted to by audiovisual terminals by the second communication unit；
First processing units call sound processing unit to handle the acoustic information, and it is single to call broadcasting driving unit control to play
Member plays processed sound.
6. the system of extension point library as claimed in claim 5, which is characterized in that audiovisual terminals further include that subtitle insertion is single
Member；
First processing units call the first communication unit to obtain the lyrics word synchronous with song files from mobile terminal or server
Curtain, and call subtitle embedded unit that the lyrics subtitle is embedded into audio video document.
7. the system of extension point library as claimed in claim 5, it is characterised in that：The wireless transmission method includes
Airplay technologies, DLNA technologies, Miracast technologies or WIDI technologies.
8. such as the system of extension point library described in claim 5 or 6, it is characterised in that：First communication unit includes wired
Communication module or wireless communication module；First communication unit obtains song files from mobile terminal or internet and specifically includes：It is logical
It crosses wired connection or wireless connection mode and obtains song files from mobile terminal or internet.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410147686.7A CN103886881B (en) | 2014-04-14 | 2014-04-14 | A kind of method and its system of extension point library |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410147686.7A CN103886881B (en) | 2014-04-14 | 2014-04-14 | A kind of method and its system of extension point library |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103886881A CN103886881A (en) | 2014-06-25 |
| CN103886881B true CN103886881B (en) | 2018-10-02 |
Family
ID=50955736
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410147686.7A Active CN103886881B (en) | 2014-04-14 | 2014-04-14 | A kind of method and its system of extension point library |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103886881B (en) |
Families Citing this family (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104485122B (en) * | 2014-11-27 | 2017-10-31 | 广东欧珀移动通信有限公司 | Communication information deriving method, device, and terminal device |
| CN104486634A (en) * | 2014-12-09 | 2015-04-01 | 北京歌华有线数字媒体有限公司 | Audio and video acquisition and synthesis system based on linkage of wired television and intelligent mobile equipment |
| CN104683853B (en) * | 2015-02-04 | 2018-09-04 | 广州酷狗计算机科技有限公司 | The acquisition device and terminal of multimedia file |
| CN104754049A (en) * | 2015-03-30 | 2015-07-01 | 福建星网视易信息系统有限公司 | Method and device for self-help song adding through cloud server |
| CN104715773B (en) * | 2015-03-30 | 2018-06-15 | 福建凯米网络科技有限公司 | A kind of self-service method and device for adding song in digital audio-video place |
| CN104882151B (en) * | 2015-06-05 | 2018-08-03 | 福建凯米网络科技有限公司 | The method, apparatus and system of multimedia resource are shown in singing songs |
| US9948980B2 (en) * | 2015-07-20 | 2018-04-17 | Google Llc | Synchronizing audio content to audio and video devices |
| CN106488328A (en) * | 2015-08-25 | 2017-03-08 | 尊博科技股份有限公司 | MTV vocal accompaniment order programme |
| CN108322830B (en) * | 2017-01-16 | 2020-11-03 | 重庆特斯联智慧科技股份有限公司 | Control method of intelligent navigation audio/video control system |
| CN107750013A (en) * | 2017-09-01 | 2018-03-02 | 北京雷石天地电子技术有限公司 | MV making, player method and device applied to Karaoke |
| CN108109609B (en) * | 2017-11-21 | 2021-07-20 | 北京小唱科技有限公司 | Audio and video recording method and device |
| CN108039184A (en) * | 2017-12-28 | 2018-05-15 | 腾讯音乐娱乐科技（深圳）有限公司 | Lyrics adding method and device |
| CN111345010B (en) * | 2018-08-17 | 2021-12-28 | 华为技术有限公司 | Multimedia content synchronization method, electronic equipment and storage medium |
| CN110390925B (en) * | 2019-08-02 | 2021-08-10 | 湖南国声声学科技股份有限公司深圳分公司 | Method for synchronizing voice and accompaniment, terminal, Bluetooth device and storage medium |
| CN113641329A (en) * | 2021-08-10 | 2021-11-12 | 广州艾美网络科技有限公司 | Sound effect configuration method and device, intelligent sound box, computer equipment and storage medium |
| CN113836344A (en) * | 2021-09-30 | 2021-12-24 | 广州艾美网络科技有限公司 | Personalized song file generation method and device and music singing equipment |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1307328A (en) * | 2000-02-02 | 2001-08-08 | 三星电子株式会社 | Method and device for renewing songs and method of supporting renew of songs in management system |
| CN102231272A (en) * | 2011-01-21 | 2011-11-02 | 辜进荣 | Method and device for synthesizing network videos and audios |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101609667B (en) * | 2009-07-22 | 2012-09-05 | 福州瑞芯微电子有限公司 | Method for realizing karaoke function in PMP player |
| CN101901595B (en) * | 2010-05-05 | 2014-10-29 | 北京中星微电子有限公司 | Method and system for generating animation according to audio music |
| CN103020173B (en) * | 2012-11-27 | 2017-02-08 | 北京百度网讯科技有限公司 | Video image information searching method and system for mobile terminal and mobile terminal |
-
2014
- 2014-04-14 CN CN201410147686.7A patent/CN103886881B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1307328A (en) * | 2000-02-02 | 2001-08-08 | 三星电子株式会社 | Method and device for renewing songs and method of supporting renew of songs in management system |
| CN102231272A (en) * | 2011-01-21 | 2011-11-02 | 辜进荣 | Method and device for synthesizing network videos and audios |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103886881A (en) | 2014-06-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103886881B (en) | A kind of method and its system of extension point library | |
| CN101770772B (en) | Embedded Internet kara OK entertainment device and method for controlling sound and images thereof | |
| CN110692252B (en) | Audio-visual collaboration method with delay management for wide area broadcast | |
| CN107027050B (en) | Audio and video processing method and device for assisting live broadcast | |
| US20070087686A1 (en) | Audio playback device and method of its operation | |
| CN112805675A (en) | Non-linear media segment capture and editing platform | |
| US20080184870A1 (en) | System, method, device, and computer program product providing for a multiple-lyric karaoke system | |
| US10565972B2 (en) | Audiovisual media application platform with wireless handheld audiovisual input | |
| CN108766410A (en) | Karaoke method, device, intelligent sound based on intelligent sound and storage medium | |
| CN104882151A (en) | Method, device and system for displaying multimedia resources in song singing | |
| CN102419998A (en) | Voice frequency processing method and system | |
| CN107770628A (en) | One kind Karaoke realization method and system, intelligent household terminal | |
| CN102693716B (en) | Television karaoke system supporting network scoring function and television karaoke realization method | |
| CN101751967B (en) | Multimedia file producing and playing method, multimedia file producing device and player | |
| CN105989824A (en) | Karaoke system of mobile device and mobile device | |
| CN205049909U (en) | Remote monitoring intelligence stereo set | |
| JP5986387B2 (en) | Information processing program, information processing apparatus, lyrics display method, and communication system | |
| TW201220297A (en) | Portable karaoke system, karaoke method and application program | |
| Hirabayashi et al. | Sense of space: the audience participation music performance with high-frequency sound id. | |
| CN109327731A (en) | A kind of real-time synthetic method of DIY video and system based on Karaoke | |
| CN202034027U (en) | High-definition audio/video device | |
| KR20150018194A (en) | Evaluation Methods and System for mimicking song | |
| CN104219556A (en) | Use method of four-soundtrack karaoke identification playing system | |
| CN104754049A (en) | Method and device for self-help song adding through cloud server | |
| WO2019051689A1 (en) | Sound control method and apparatus for intelligent terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20151102 Address after: 350018 Fujian city of Fuzhou province Nanjiang gate town of Cangshan District West Coast Road No. 198 Fuzhou Strait International Convention and Exhibition Center basement East Office Center No. A-029 (FTA test area) Applicant after: FUJIAN KAIMI NETWORK SCIENCE & TECHNOLOGY CO., LTD. Address before: Cangshan District of Fuzhou City, Fujian province 350008 Jinshan Road No. 618 juyuanzhou Industrial Zone Ruijie Science Park building 20, four floor Applicant before: Fujian Starnet e-Video Information System Co., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |