CN101345047A - Sound mixing system and method for automatic human voice correction - Google Patents

Sound mixing system and method for automatic human voice correction Download PDF

Info

Publication number
CN101345047A
CN101345047A CNA2007101294233A CN200710129423A CN101345047A CN 101345047 A CN101345047 A CN 101345047A CN A2007101294233 A CNA2007101294233 A CN A2007101294233A CN 200710129423 A CN200710129423 A CN 200710129423A CN 101345047 A CN101345047 A CN 101345047A
Authority
CN
China
Prior art keywords
song
voice
time
recording
time mark
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2007101294233A
Other languages
Chinese (zh)
Other versions
CN101345047B (en
Inventor
邱全成
刘晓安
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
IValley Holding Co., Ltd.
Original Assignee
Inventec Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inventec Corp filed Critical Inventec Corp
Priority to CN200710129423A priority Critical patent/CN101345047B/en
Publication of CN101345047A publication Critical patent/CN101345047A/en
Application granted granted Critical
Publication of CN101345047B publication Critical patent/CN101345047B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention provides a sound-mixing system with automatically corrected voice, and a sound-mixing method thereof, aiming at solving the problem that the voice is not easy to be aligned to accompanied songs during the recording process; the sound-mixing method with automatically corrected voice and disclosed by the invention comprises the steps as follows: all different starting time of accompanied songs and corresponding original songs are recorded as a first time mark; recorded songs with voices are read; the starting time of voice appearing in the recorded song is analysed and recorded as a second time mark; each first time mark is sequentially corresponding to each second time mark; according to the corresponding relationship of all the first time marks and al the second time marks, the recorded songs are mixed into the accompanied songs; the starting time when voice appears in the recorded song is corresponding to the starting time when voice is supposed to appear in the accompanied song, and the recorded song and the accompanied song are mixed further, thus achieving the efficacy of automatic voice correction.

Description

Voice is from the mixer system and the sound mixing method thereof of normal moveout correction
Technical field
The present invention relates to a kind of mixer system and sound mixing method, be meant mixer system and the sound mixing method thereof of a kind of voice especially from normal moveout correction.
Background technology
Singing has become one of stress-relieving activity of modern, therefore as the people to the sound of oneself and after singing skills have certain confidence, just can further want the SoundRec of oneself is got off, use being shared with other people, therefore the demand of recording also just constantly improves.
Recording is meant the process that sound is transferred to anaiog signal or numerical digit signal.The quality of recording is subjected to the influence of sampling frequency and sampling resolution.For different sound, suitable sampling frequency is also different: the sampling frequency of music is 10 to 20000 hertz (Hz); And the sampling frequency of voice is 300 to 3400 hertz.
Though the demand of recording increases, but sound pick-up outfit too costliness so that common people cannot afford, therefore the method for at present common recording typically uses computer and plays accompanying song, and use the microphone that connects computer to record, such mode but causes voice and accompanying song can't sing in the only time because of artificial error easily, cause different Walk of voice and accompanying song, make that the song after recording is unsatisfactory.
Summary of the invention
Propose in the prior art at present in view of above that voice and the nonsynchronous present situation of accompanying song take place common record type easily, the object of the invention is to provide a kind of mixer system and sound mixing method that can automatically voice be aligned, and can can't sing problem in the only time with solving voice.
In the mixer system of the disclosed voice of the present invention from normal moveout correction, it includes: storage module, analysis module, audio mixing module.
In the sound mixing method of the disclosed voice of the present invention from normal moveout correction, it includes: record accompanying song and all zero-times that do not exist together of corresponding original song are very first time mark; Read the recording song that includes voice; The zero-time of voice occurs in the analysis recording song, and be recorded as second time mark; In regular turn each very first time mark is corresponded to each second time mark; Be mixed in the accompanying song according to the corresponding relation of each very first time mark and each the second time mark song of will recording.
The recording system of the present invention and the way of recording are by the mode of the zero-time of voice is arranged in the zero-time that voice is arranged in the corresponding accompanying song and the song of recording, mix accompanying song and recording song, use solving voice and can't sing problem in the only time.
Contrasting is beyond one's reach in known use computer and microphone location aligns the effect of voice, the present invention can be automatically with people's acoustic correction to the correct time, make the voice in the recording song can correspond to optimal position in the accompanying song automatically, solve known technology the effect that can't reach.
About detailed features of the present invention and real the work, now cooperate to be shown in the embodiment and be described in detail as follows, its content is enough to make any related art techniques person of haveing the knack of to understand technology contents of the present invention and implements according to this, and according to the disclosed content of this instructions and graphic, any related art techniques person of haveing the knack of can understand purpose and the advantage that the present invention is correlated with easily.
Description of drawings
Fig. 1 is the system architecture diagram of the voice carried of the present invention from the mixer system of normal moveout correction.
Fig. 2 is the method flow diagram of the voice carried of the present invention from the sound mixing method of normal moveout correction.
Fig. 3 A is the accompanying song synoptic diagram that the embodiment of the invention is carried.
Fig. 3 B is the recording song synoptic diagram that the embodiment of the invention is carried.
Fig. 3 C is the audio mixing song synoptic diagram that the embodiment of the invention is carried.
Embodiment
Following elder generation illustrates System Operation of the present invention with the voice that Fig. 1 the present invention is carried from the mixer system Organization Chart of normal moveout correction.As shown in the figure, system of the present invention contains storage module 110, analysis module 120, audio mixing module 130.
The original song that the present invention carried is meant and includes the voice that the original singer sings and the song of the melody of having powerful connections; The accompanying song that the present invention carried is meant the song of having powerful connections melody and not having the voice that the original singer sings; And the recording song that the present invention carried be by the person for recording follow accompanying song hum the sound under the record, may only have only voice, also may include voice and accompanying song.
Storage module 110 is responsible for storing recording song, and the very first time mark of accompanying songs, corresponding accompanying song, wherein very first time mark is between accompanying song and corresponding original song, the zero-time of voice just should appear in the zero-time that the sound after the broadcast does not exist together in original song.
Analysis module 120 is responsible for by after reading the recording song that comprises at least one voice in the storage module 110, analyzes the zero-time that occurs voice in the recording song, and the zero-time that voice appears in record is second time mark.Because analyzing the technology of voice has been known technology, for example judges whether sound drops on the modes such as frequency separation of specific (voice), so not explanation in detail in the present embodiment.
The zero-time of voice corresponds to voice in the recording song that second time mark comprised zero-time should be arranged in the accompanying songs that audio mixing module 130 is responsible in regular turn very first time mark being comprised, and according to the corresponding relation of the very first time mark and second time mark, the song of will recording is mixed in the accompanying song.
Then explain orally operation system of the present invention and method, and please refer to voice that Fig. 2 the present invention carried sound mixing method process flow diagram from normal moveout correction with an embodiment.
Because accompanying song 310 is that with corresponding original song difference accompanying song 310 does not have voice, and original song has original singer's voice, therefore, at prelude and part such as play, the part that does not just have voice, accompanying song 310 and corresponding original song will be identical at the sound of the time point of same broadcast, and when the original singer sent voice and sings, accompanying song 310 can be different at the sound of the time point of same broadcast with original song.The accompanying song of being carried in the present embodiment 310 as shown in Figure 3A, is located at 0:22 to 2:13,2:33 to 3:59 and 4:15 to 4:33, with accompanying song 310 corresponding original songs voice is arranged.
In the present invention, storage module 110 can store accompanying song 310 and very first time mark (step 210) in advance.Generally speaking, the voice of original song has a plurality of paragraphs, so very first time mark normally should be made up of the zero-time of voice by several, therefore, the very first time of present embodiment is labeled as 0:22,2:33 and 4:15.
Analysis module 120 of the present invention can be by the recording song 320 (step 230) of reading corresponding accompanying song 310 in the storage module 110, if have only voice in the recording song 320, do not comprise accompanying song 310 or other melody, then analysis module 120 can analyze the part that voice is arranged in the recording song 320 easily, and will there be the zero-time of the part of voice to note, become second time mark (step 240), shown in Fig. 3 B, at 0:23 to 2:13,2:33 to 3:58, and there is voice at 4:15 to 4:34 place, and therefore second time mark is 0:23,2:33, and 4:15.
Then, audio mixing module 130 of the present invention can correspond to second time mark with very first time mark respectively in regular turn, and the corresponding relation of foundation is carried out audio mixing, just audio mixing module 130 can correspond to the 0:22 of accompanying song 310 0:23 of recording song 320, the 2:33 of accompanying song 310 corresponds to the 2:33 of recording song 320, the 4:15 of accompanying song 310 corresponds to the 4:15 of recording song 320, after correspondence is finished, audio mixing module 130 can be begun accompanying song 310 by 0:22, recording song 320 is begun to carry out audio mixing by 0:23, the meaning song 320 of promptly recording is the 0:22 places that begun to sneak into accompanying song 310 by the 0:23 place, same, audio mixing module 130 can be in regular turn recording song 320 by 2:33, and the 4:15 place begins to sneak into the 2:33 of accompanying song 310, and 4:15 place (step 260), can produce the audio mixing song 330 that audio mixing is finished after the mixing, shown in Fig. 3 C.
In Fig. 3 C, can also find,, but finish in 3:58 in advance though the voice that the recording song begins in the 2:33 place is not to finish at 3:59; Finish in 4:33 by the voice of 4:15 place beginning is also non-in addition, finish, the part that finishes in advance or delay end is not carried out extra processing but the present invention only carries out audio mixing but delay in 4:34.
So, the present invention promptly can be automatically correspond to optimal time point in the accompanying song 310 to the voice in the recording song 320, causes the nonsynchronous problem of voice and accompanying song when solving the recording that prior art proposes easily because of human error.
In fact, the present invention is not limited in passive wait very first time mark and is stored in the storage module 110 by the user, therefore the present invention has more comprised detecting module 160, be responsible for when storage module 110 stores original song, detect the sound difference that original song and accompanying song 310 are play, and it is recorded to use in the storage module 110 forms very first time mark, as described in when the principle of detecting module 160 detectings begins as present embodiment, whether the time point accompanying song 310 of detecting same broadcast is identical with the sound that original playback of songs goes out, in case sound difference, detecting module 160 promptly can be detected out by the time point that the sound that accompanying song 310 and original playback of songs go out is different, and it is recorded as very first time mark.And the mode of detecting can directly be opened the original song that is stored in the storage module 110 and the archives of accompanying song 310 are compared by detecting module 160, not necessarily need original song and accompanying song 310 are play just and can be compared, because the mode of comparison is a known technology, therefore do not describe in detail in the present embodiment.In addition, detecting module 160 also can directly be detected the part that voice is arranged in the accompanying song 310 pairing original songs, use the zero-time that voice will be arranged and be recorded as very first time mark, using provides audio mixing module 130 to mix accompanying song 310 and recording song 320, the technology of wherein detecting voice is also for known, therefore additional description no longer.
The present invention can also comprise recording module 170, in order to receive the sound that the user sent, and it be stored in the storage module 110 form recording song 320 (step 220), make analysis module 120 read recording song 320 (step 230) go forward side by side pedestrian's sound analysis and obtain second time mark and with it record (step 240).That is to say that the recording song 320 that the present invention carried can be stored in the storage module 110 in advance, also can store via voice under recording module 170 records.
In addition, the present invention more can comprise filtering module 190, in order to by read in the storage module 110 recording song 320, and analyze the noise (step 250) of the part of no voice in the temporal filtering recording song of being learnt the back 320 that does not have voice according to analysis module 120, make audio mixing module 130 when mixing accompanying song 310 with recording song 320, noise in the recording song 320 can be filtered module 190 and remove, the quality behind the raising audio mixing.
When the present invention comprises filtering module 190, if having more than, recording song 320 comprises voice, and also comprised accompanying song 310, then analysis module 120 is being read recording song 320 backs (step 230), to analyze recording song 320, use and analyze the part that voice is arranged in the recording song 320, and the zero-time that the part of voice will be arranged is recorded as second time mark (step 240), then filtering module 190 just can be according to the analysis result of analysis module 120, to have only accompaniment and not have the part filtration of voice to become quiet (step 250), so audio mixing module 130 just can be mixed the part that voice is arranged in accompanying song 310 and the recording song 320.
Moreover voice of the present invention can be implemented in the combination of hardware, software or hardware and software from the sound mixing method of normal moveout correction, also can realize or intersperse among with different elements the dispersing mode of the computer system of several interconnected with centralized system and realize in computer system.
Though the present invention discloses as above with aforesaid embodiment; right its is not in order to limit the present invention; any skill person who has the knack of the technical field of the invention; without departing from the spirit and scope of the present invention; change of doing and retouching; therefore all belong to scope of patent protection of the present invention, scope of patent protection of the present invention must be looked the appended claim scope person of defining of this instructions and is as the criterion.

Claims (10)

1, a kind of voice is from the sound mixing method of normal moveout correction, and this sound mixing method comprises the following step:
Write down that in the original song of an accompanying song correspondence zero-time of voice to be arranged be very first time mark;
Read a recording song that includes at least one voice, wherein should recording song to should accompanying song;
Analyze this recording song, and the zero-time that occurs this voice in the song of will recording is recorded as second time mark;
In regular turn will be respectively this second time mark correspond to respectively should very first time mark; And
According to respectively should very first time mark being mixed in this accompanying song with the song of should recording of the corresponding relation of this second time mark respectively.
2, voice as claimed in claim 1 is from the sound mixing method of normal moveout correction, wherein the step of this very first time mark of this record more comprises this original song of comparison and this accompanying song, the sound of playing in same time point when this original song and this accompanying song writes down the step of this zero-time that does not exist together for this very first time mark not simultaneously.
3, voice as claimed in claim 1 is from the sound mixing method of normal moveout correction, and wherein the step of this very first time mark of this record more comprises the zero-time that voice is arranged in this original song of detecting, writes down the step of this zero-time for this very first time mark.
4, voice as claimed in claim 1 more comprises the part of filtering no voice in this recording song from the sound mixing method of normal moveout correction, makes the part of this no voice form quiet step.
5, voice as claimed in claim 4 is from the sound mixing method of normal moveout correction, wherein the step of the part of no voice more comprises the part of analyzing no voice in this recording song earlier in this recording song of this filtration, filters the step of the part of no voice in this recording song again according to analysis result.
6, a kind of voice is from the mixer system of normal moveout correction, and this mixer system comprises:
One storage module, in order to storing an accompanying song, corresponding with this accompanying song and include a recording song of at least one voice, and in the record original song corresponding with this accompanying song the zero-time of voice to be arranged be very first time mark;
One analysis module the zero-time of this voice occurs in order to analyze in this recording song, and is recorded as second time mark; And
One audio mixing module, in order to will be respectively this second time mark correspond in regular turn respectively should very first time mark, and according to respectively should very first time mark being mixed in this accompanying song with the song of should recording of the corresponding relation of this second time mark respectively.
7, voice as claimed in claim 6 is from the mixer system of normal moveout correction, and wherein this storage module is more in order to store this original song.
8, voice as claimed in claim 7 is from the mixer system of normal moveout correction, more comprise a detecting module, in order to compare this original song and the sound of this accompanying song when being played at the same time, when the sound of this original song and this accompanying song not simultaneously, this zero-time that does not exist together be defined as this very first time mark and be stored in this storage module.
9, voice as claimed in claim 7 more comprises a detecting module from the mixer system of normal moveout correction, and in order to detect the zero-time that voice is arranged in this original song, this zero-time is stored to becomes this very first time mark in this storage module.
10, voice as claimed in claim 6 more comprises a filtering module from the mixer system of normal moveout correction, and in order to analyze the result of this recording song according to this analysis module, the part of filtering no voice in this recording song makes the part of this no voice form quiet.
CN200710129423A 2007-07-12 2007-07-12 Sound mixing system and method for automatic human voice correction Active CN101345047B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN200710129423A CN101345047B (en) 2007-07-12 2007-07-12 Sound mixing system and method for automatic human voice correction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200710129423A CN101345047B (en) 2007-07-12 2007-07-12 Sound mixing system and method for automatic human voice correction

Publications (2)

Publication Number Publication Date
CN101345047A true CN101345047A (en) 2009-01-14
CN101345047B CN101345047B (en) 2012-09-05

Family

ID=40247039

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200710129423A Active CN101345047B (en) 2007-07-12 2007-07-12 Sound mixing system and method for automatic human voice correction

Country Status (1)

Country Link
CN (1) CN101345047B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103295568A (en) * 2013-05-30 2013-09-11 北京小米科技有限责任公司 Asynchronous chorusing method and asynchronous chorusing device
CN103377649A (en) * 2012-04-20 2013-10-30 上海渐华科技发展有限公司 Method for achieving network karaoke antiphonal singing in real time
CN104332166A (en) * 2014-10-21 2015-02-04 福建歌航电子信息科技有限公司 Method of quickly verifying accuracy and synchronization of a recorded audio content
US9224374B2 (en) 2013-05-30 2015-12-29 Xiaomi Inc. Methods and devices for audio processing
CN105741830A (en) * 2014-12-12 2016-07-06 深圳市腾讯计算机系统有限公司 Method and device for audio synthesis
CN105788581A (en) * 2014-12-15 2016-07-20 深圳Tcl新技术有限公司 Karaoke scoring method and device
CN108010503A (en) * 2017-12-27 2018-05-08 北京酷我科技有限公司 A kind of method of K songs recording
CN112017622A (en) * 2020-09-04 2020-12-01 广州趣丸网络科技有限公司 Audio data alignment method, device, equipment and storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3068226B2 (en) * 1991-02-27 2000-07-24 株式会社リコス Back chorus synthesizer
US5974387A (en) * 1996-06-19 1999-10-26 Yamaha Corporation Audio recompression from higher rates for karaoke, video games, and other applications
US20030007611A1 (en) * 2000-05-15 2003-01-09 Junichi Morita Voice storage system, exchange and voice storage apparatus
KR100555499B1 (en) * 2003-06-02 2006-03-03 삼성전자주식회사 Music/voice discriminating apparatus using indepedent component analysis algorithm for 2-dimensional forward network, and method thereof
US7134876B2 (en) * 2004-03-30 2006-11-14 Mica Electronic Corporation Sound system with dedicated vocal channel

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103377649A (en) * 2012-04-20 2013-10-30 上海渐华科技发展有限公司 Method for achieving network karaoke antiphonal singing in real time
CN103377649B (en) * 2012-04-20 2015-09-09 上海渐华科技发展有限公司 A kind of method realizing real-time network Karaoke antiphonal singing
KR101686632B1 (en) * 2013-05-30 2016-12-15 시아오미 아이엔씨. Asynchronous chorus method, device, program and recording medium
WO2014190786A1 (en) * 2013-05-30 2014-12-04 小米科技有限责任公司 Asynchronous chorus method and device
RU2635835C2 (en) * 2013-05-30 2017-11-16 Сяоми Инк. Method and device for asynchronous choral performance
KR20150079763A (en) * 2013-05-30 2015-07-08 시아오미 아이엔씨. Asynchronous chorus method and device
CN103295568B (en) * 2013-05-30 2015-10-14 小米科技有限责任公司 A kind of asynchronous chorus method and apparatus
US9224374B2 (en) 2013-05-30 2015-12-29 Xiaomi Inc. Methods and devices for audio processing
CN103295568A (en) * 2013-05-30 2013-09-11 北京小米科技有限责任公司 Asynchronous chorusing method and asynchronous chorusing device
EP3007163A4 (en) * 2013-05-30 2016-12-21 Xiaomi Inc Asynchronous chorus method and device
CN104332166B (en) * 2014-10-21 2017-06-20 福建歌航电子信息科技有限公司 Can fast verification recording substance accuracy, the method for synchronism
CN104332166A (en) * 2014-10-21 2015-02-04 福建歌航电子信息科技有限公司 Method of quickly verifying accuracy and synchronization of a recorded audio content
CN105741830A (en) * 2014-12-12 2016-07-06 深圳市腾讯计算机系统有限公司 Method and device for audio synthesis
CN105741830B (en) * 2014-12-12 2020-12-04 广州酷狗计算机科技有限公司 Audio synthesis method and device
CN105788581A (en) * 2014-12-15 2016-07-20 深圳Tcl新技术有限公司 Karaoke scoring method and device
CN105788581B (en) * 2014-12-15 2019-05-31 深圳Tcl新技术有限公司 Karaoke Marking method and apparatus
CN108010503A (en) * 2017-12-27 2018-05-08 北京酷我科技有限公司 A kind of method of K songs recording
CN112017622A (en) * 2020-09-04 2020-12-01 广州趣丸网络科技有限公司 Audio data alignment method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN101345047B (en) 2012-09-05

Similar Documents

Publication Publication Date Title
CN101345047B (en) Sound mixing system and method for automatic human voice correction
CN1741130B (en) Reproduction apparatus and reproduction system
JPH0916189A (en) Karaoke marking method and karaoke device
KR960042718A (en) Karaoke device, audio playback device, and recording medium used for this
WO2010024426A1 (en) Sound recording device
CN102969010A (en) Recording and playback device, storage medium, and recording and playback method
JP2006330170A (en) Recording document preparation support system
JP2008047998A (en) Moving video reproducer, and moving video reproducing method
JP3978909B2 (en) Karaoke equipment
CN101488356B (en) Overdubbing device
CN101154175A (en) Audio testing method and system combining with voice recognition
CN1617182A (en) Method of recording and playing compact disk quality sound signals for a doorbell system, and a receiver
Skea Rudy Van Gelder in Hackensack: Defining the jazz sound in the 1950s
JP6326822B2 (en) Recording method
TW526407B (en) Digital recording and displaying device
JP2001283516A (en) Method for writing reproducible data on data carrier
CN102044238B (en) Music reproducing system
JP2000137490A (en) Karaoke sing-along machine
CN1047901C (en) Device and method for controlling OSD of a karaoke system
JPS5814189A (en) Performance recording controller
KR20210105735A (en) Apparatus for taking the minutes of a meeting
JPS5991391A (en) Message timepiece
JP3698050B2 (en) Voice response method and voice response system
CN109151705A (en) A kind of alignment schemes and relevant device of conferencing data
US20010056432A1 (en) AV information processing unit and information recording medium, in which AV information processing program is recorded so as to be capable of being read by computer

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
ASS Succession or assignment of patent right

Owner name: I VALLEY HOLDINGS CO., LTD.

Free format text: FORMER OWNER: YINGYEDA CO., LTD., TAIWAN

Effective date: 20150730

C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20150730

Address after: Cayman Islands, George Town

Patentee after: IValley Holding Co., Ltd.

Address before: Taipei City, Taiwan Chinese Shilin District Hougang Street No. 66

Patentee before: Inventec Corporation