CN102822887B - mixing data delivery server - Google Patents

mixing data delivery server Download PDF

Info

Publication number
CN102822887B
CN102822887B CN201180014836.1A CN201180014836A CN102822887B CN 102822887 B CN102822887 B CN 102822887B CN 201180014836 A CN201180014836 A CN 201180014836A CN 102822887 B CN102822887 B CN 102822887B
Authority
CN
China
Prior art keywords
data
sound
voice data
mixing
singing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201180014836.1A
Other languages
Chinese (zh)
Other versions
CN102822887A (en
Inventor
松本秀一
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yamaha Corp
Original Assignee
Yamaha Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yamaha Corp filed Critical Yamaha Corp
Publication of CN102822887A publication Critical patent/CN102822887A/en
Application granted granted Critical
Publication of CN102822887B publication Critical patent/CN102822887B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/36Accompaniment arrangements
    • G10H1/361Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
    • G10H1/365Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems the accompaniment information being stored on a host computer and transmitted to a reproducing terminal by means of a network, e.g. public telephone lines
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K15/00Acoustics not otherwise provided for
    • G10K15/02Synthesis of acoustic waves
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K15/00Acoustics not otherwise provided for
    • G10K15/04Sound-producing devices

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Reverberation, Karaoke And Other Acoustics (AREA)
  • Electrophonic Musical Instruments (AREA)

Abstract

The invention provides a kind of can stored sound and musical sound and do not make the server that call duration time increases respectively.Only the sound of singing of chanteur is uploaded as voice data (singing file) to central part together with the synchronizing information played of playing Karaoka.In synchronizing information, at least record speed and the information volume of the Karaoke melody played when voice data is recorded.Central part is play singing file, generates singing voice signal, and carries out Karaoke performance with speed described in synchronizing information, volume, generates note signal.By carrying out mixing to generated singing voice signal and note signal, thus generate new voice data (mixing data).

Description

Mixing data delivery server
Technical field
The present invention relates to a kind of send sound and musical sound are carried out mixing after the server of voice data that obtains.
Background technology
Current, propose and a kind ofly to upload by the voice data that sound and musical sound form of singing utilizing Caraok device to record to server, and the system of voice data being sent to each user by server (with reference to patent documentation 1).In patent documentation 1, describe following technology, that is, each user is by listening to singing sound and musical sound and marking of sent voice data, thus carries out Karaoke match.
Patent documentation 1: Japanese Unexamined Patent Publication 2007-121550 publication
Summary of the invention
In the system of patent documentation 1, will sound be sung and musical sound stores in the server as the voice data of 1 after mixing.Therefore, the later stage cannot adjust the mixing balance singing sound and musical sound.Also contemplate to adjust the mixing balance singing sound and musical sound in the later stage, and the technology that will sound and musical sound be sung upload as independent voice data, if but will sound be sung and musical sound is uploaded respectively, would then produce the problem of the call duration time of existing more than 2 times of cost.
Therefore, the object of the invention is to, providing a kind of can store sound and musical sound respectively and not make the server that call duration time increases.
Mixing data delivery server of the present invention has receiving element, storage unit, voice data generation unit and delivery unit.Receiving element receives the voice data of chanteur and the voice data of above-mentioned chanteur and the synchronizing information played of playing Karaoka.The voice data of the chanteur received by cell stores and synchronizing information.In addition, storage unit also stores for carrying out the music data played of playing Karaoka.
Voice data generation unit is play the voice data read from storage unit, and reads music data based on synchronizing information, carries out automatic Playing.In addition, voice data generation unit carries out mixing to based on the sound of voice data play and the musical sound of automatic Playing, generates mixing data.Generated mixing data are sent to each terminal, becomes the state that user can listen to.
As noted above, by chanteur sing sound with Karaoke play sound synchronizing information together with, upload to server as voice data, for musical sound, generating by carrying out automatic Playing based on synchronizing information to music data at server side, carrying out mixing with the broadcasting sound of voice data and generating mixing data (partial data by singing sound and musical sound and forming).Therefore, by only uploading the voice data singing sound, thus become the state at server side respectively stored sound and musical sound, and it is compared with prior art constant to upload the required time.
In addition, the speed of Karaoke melody played when also can be and record voice data recording in synchronizing information and the mode of information volume.Thus, when the later stage plays the voice data singing sound, realize singing the synchronous Karaoke of sound with this and play.
In addition, also can be that voice data is made up of multiple voice data, synchronizing information includes the mode of the information of the respective broadcasting timing representing above-mentioned multiple voice data.Such as, if duet song, then because chanteur carries out singing of duet part, the time period of carrying out singing in 1 first song is determined, so can be also multiple by singing file division.In the case, in synchronizing information, record the information representing elapsed time from playing or mistiming in advance, by playing respectively singing file with reference to this information when playing, also can carry out the Karaoke synchronous with singing sound and playing.
In addition, the mixing data generated also can be preserved in the memory unit.In the case, even if when there is multiple delivery request at the same time, also can send immediately.In the case, because the voice data singing sound is preserved in the memory unit, so after this mixing balance can be being changed.
In addition, also can adopt following manner, that is, in synchronizing information, comprise efficacy parameter, voice data generation unit, when the mixing of musical sound carrying out automatic Playing, reflects the setting of this efficacy parameter.Thus, reflection in the effect set when singing sound recording can being played to Karaoke, the user sent accepting mixing data can enjoy the performance having more presence.
The effect of invention
According to the present invention, can stored sound and musical sound and do not make call duration time increase respectively in the server.
Accompanying drawing explanation
Fig. 1 is the block diagram of the structure representing karaoke OK system.
Fig. 2 is the block diagram of the structure representing Caraok device.
Fig. 3 is the figure of the structure representing various data.
Fig. 4 is the block diagram of the structure representing central part.
Fig. 5 is the figure singing the example of the guide look of file representing display on WEB.
Fig. 6 is the block diagram of the structure representing user PC.
Fig. 7 is the process flow diagram be described the action logged in when singing file.
Fig. 8 is the process flow diagram be described action when sending duet.
Embodiment
Fig. 1 is the figure of the structure representing mixing data delivery system.Mixing data delivery system is made up of central part (server, mixing data delivery server) 1, multiple Karaoke shop 3 and multiple user PC 4, and they connect via the network 2 be made up of internet etc.In each Karaoke shop 3, the multiple Caraok devices 7 being provided with the repeaters 5 such as the router be connected with network 2 and being connected with network 2 via repeater 5.Repeater 5 be arranged on Karaoke shop caretaker room in etc.Multiple stage Caraok device 7 respectively arranges 1 respectively in separate room (Kara OK box).User PC 4 is common home-use personal computers.
For the mixing data delivery system of present embodiment, in advance the sound that certain chanteur is sung by Caraok device 7 is recorded, and upload to central part 1 as singing file (compression sound data).Then, central part 1 is play according to the request of each user PC 4 and is sung file, plays with play Karaoke of carrying out with singing file synchronization, generates and will sing sound and musical sound mixing and the mixing data (compression sound data) obtained, and send to user PC 4.Below, each structure for realizing this mixing data delivery system and action are described.
Fig. 2 is the block diagram of the structure representing Caraok device.Caraok device 7 is made up of the CPU 11 of control device molar behavior and the various structural portion that are connected with CPU 11.CPU 11 is connected with demoder 22 and the Graphics Processing portion 23 such as RAM 12, HDD 13, network interface (I/F) 14, operating portion 15, A/D transducer 17, sound source 18, frequency mixer (effect device) 19, MPEG.
HDD 13 stores for playing the music data of Karaoke melody and the image data etc. for display background image on the display 24.As image data, store dynamic image, still image these two kinds.
As in the RAM 12 of working storage, be set with dynamic action routine for reading CPU 11 with perform this program region and for reading music data to play the region etc. of Karaoke melody.
CPU 11 is functionally built-in with sequencer.Sequencer is that the music data for storing in HDD 13 reads and performs the program of Karaoke performance.As shown in Fig. 3 (A), music data is made up of following part etc.: the head being written with melody numbering etc., the musical sound sound rail being written with performance MIDI data, be written with the guiding melody sound rail guiding melody MIDI data, the lyrics rail being written with lyrics MIDI data, be written with the chorus sound rail of voice data that background chorus plays timing and should play.Sequencer, based on musical sound sound rail and the data guiding melody sound rail, controls sound source 18, produces the musical sound of Karaoke melody.In addition, the voice data (compression sound data such as incidental MP3 of music data) of the fixed time airplay background chorus of sequencer specified by chorus sound rail.In addition, sequencer, based on lyrics rail, synchronously synthesizes the character pattern (pattern) of the lyrics with the progress of melody, and is that signal of video signal inputs to Graphics Processing portion 23 by this word pattern change.
Sound source 18 from the data (note events (note event) data) that CPU 11 inputs, forms note signal (digital audio signal) according to the process by sequencer.Formed note signal is inputted to frequency mixer 19.
Frequency mixer 19 applies to the note signal formed by sound source 18, chorus sound and the singing voice signal of chanteur that inputs via A/D transducer 17 from microphone 16 effects such as echoing, and carries out mixing to above-mentioned signal.
Each digital audio signal after mixing is inputted to sound system (SS) 20.Sound system 20 is built-in with D/A transducer and power amplifier, inputted digital signal conversion is simulating signal and amplifies, from loudspeaker 21 playback.The effect applied each voice signal by frequency mixer 19 and the balance of mixing, controlled by CPU 11.
The generation of CPU 11 and the musical sound realized by above-mentioned sequencer, the generation of lyrics captions (telop) synchronously, read the image data stored in HDD 13 and also play background video etc.The image data of dynamic menu is encoded in the mpeg format.Read-out image data inputs to mpeg decoder 22 by CPU 11.Inputted mpeg data is transformed to signal of video signal by mpeg decoder 22, and inputs to Graphics Processing portion 23.Except input the signal of video signal of background video in Graphics Processing portion 23 except, also input the character pattern etc. of above-mentioned lyrics captions.Graphics Processing portion 23, on the signal of video signal of background video, utilizes OSD(OnScreen Display) synthesize lyrics captions etc., and export to display 24.Display 24 shows the signal of video signal inputted from Graphics Processing portion 23.
Operating portion 15 is by the various keyswitch on the guidance panel face being arranged on Caraok device 7 and form via the telepilot etc. that infrared communication etc. connects, and accepts the various operations of user, and is inputted to CPU 11 by the operation information corresponding with mode of operation.Operating portion 15 accepts melody request, sings sound recording (register) etc.
CPU 11 is when wishing that the chanteur of public singing sound utilizes operating portion 15 to carry out singing register and the melody appointment of sound, the Karaoke carrying out specified melody is played, and based on the singing voice signal of the chanteur inputted via AD transducer 17 from microphone 16, file is sung in generation, uploads to central part 1 via network I/F 14.Sing file to generate as compression sound datas such as MP3.Now, CPU 11 generates the synchronizing information representing the incidence relation carrying out the Karaoke melody played and sing file, and uploads with singing together with file.
Fig. 3 (B) is the figure of the example representing synchronizing information.Fig. 3 (C) is the figure representing the example singing file.As shown in Fig. 3 (B), synchronizing information is made up of head, velocity information, information volume (Vol.), timing information (velocity variable).Melody numbering or song name, the associated filename etc. singing file is recorded in head.Melody numbering is the data (showing as English, digital information) of the melody numbering same format of giving with the music data to each Karaoke melody, is recorded in specified melody when chanteur carries out register and numbers.Velocity information is the information of the performance speed representing the melody specified when chanteur carries out register, is used to specify the stepping rate of sequencer.If chanteur does not carry out appointment, the change of speed when register, then directly record the standard speed of music data.Information volume is the information of the volume (volume of musical sound sound rail) representing the melody specified when chanteur carries out register.Timing information represents when making velocity variations during chanteur sings, the information of the timing (from playing elapsed time) of this velocity variations.By referring to representing the timing information of this velocity variations, thus can broadcasting afterwards time, also make performance velocity variations in the midway of melody.
Sing file as shown in Fig. 3 (C), be made up of head and singing voice data.In head, at least record filename, be associated with the head of synchronizing information.If coded format is MP3, then head also can be the mode recorded as ID 3 label.
By above various synchronizing information and sing file and upload to central part 1, and be stored in central part 1.In addition, chanteur also can use operating portion 15 to input self brief introduction (profile) and message (message) etc., uploads as chanteur's information.
In central part 1, play store respectively sing file time, with reference to the synchronizing information respectively singing file, the music data of being numbered by specified melody reads, and carries out Karaoke performance with the speed described in synchronizing information, volume.When recording the timing information representing velocity variations, according to this timing information, make performance velocity variations in the midway of melody.Thus, Karaoke when can reproduce recording is played, and generates the singing voice signal of broadcasting and the mixing data after carrying out mixing by the note signal playing generation (partial data by singing sound and musical sound and forming).Therefore, even if only upload the voice data singing sound, also become the state singing sound and musical sound in server side storage, thus can will sing sound and musical sound stores respectively, and do not make to upload the required time and increase.
In addition, sing in file shown in Fig. 3 (C), when have recorded from the performance of Karaoke melody until all sound at the end of playing (by microphone 16 pickup to sound).In the case, if while Karaoke is played and started, export the voice signal based on singing file, then can synchronously play, but such as also can as shown in Fig. 3 (E), be multiplely sing file by the file division of singing in 1 first melody.In the case, also can as shown in Fig. 3 (D), in synchronizing information, as represent the broadcasting timing respectively singing file information and record represent elapsed time from playing information or mistiming of singing between file (for file of singing at first, it is the time counted from playing), when playing with reference to the timing information of synchronizing information, and broadcasting respectively sings file.Now, synchronizing information also can be formed as MIDI data (the expansion rail of music data), to obtain the unification of the implementation (implementation) between music data, and the form adopting sequencer can read.In the case, owing to not recording to singing sound in the time period of not carrying out singing, so the data capacity singing file can be reduced, uplink time can be shortened further.The time period of carrying out singing in 1 first melody is (such as in duet melody, when chanteur only sings 1 duet part) when being restricted, particularly useful.
Below, Fig. 4 is the block diagram of the structure representing central part 1.Central part 1 is by the CPU 31 controlled the action of central part entirety and the various Structure composing be connected with CPU 31.CPU 31 is connected with RAM 32, HDD 33, network interface (I/F) 34, sound source 38 and frequency mixer (effect device) 39.
In HDD 33, except singing except file, synchronizing information and chanteur's information of uploading from each Caraok device 7, also store the music data with Caraok device 7 equal number.In addition, the mixing data of the generation of also storing over.In addition, record the dynamic action routine of CPU 31 in HDD 33, this dynamic action routine launches and carries out various process by CPU 31 in RAM 32.
Such as, CPU 31 carries out reception data processing, that is, sing file, synchronizing information and chanteur's information to record HDD33 by what receive from each Caraok device 7 via network I/F 34.In addition, CPU 31 is functionally built-in with sequencer, identically with Caraok device 7, read music data and carries out Karaoke performance, by controlling sound source 38, thus can generate note signal from HDD 33.In addition, CPU 31 edits each chanteur's information, generating the html file (not shown) for carrying out having a guide look of display, carrying out WEB Graphics Processing, that is, user PC 4 showing as WEB page.
Fig. 5 represents the figure singing the example of the guide look of file shown as WEB page.As shown in Figure 5, in WEB page, for respectively singing file, when carrying out register according to filename (or melody numbering), song name, chanteur, the project such as brief introduction, message of input carries out guide look display.In addition, the pouplarity (download time) etc. respectively singing file is also shown.The download time respectively singing file is recorded in HDD 33, carries out count increments when downloading and sing file in each Caraok device 7.User PC 4 passes through access WEB page, thus can with reference to this guide look, and that can select the chanteur wishing to listen to sings file.In addition, if operate user PC 4 and select projects, then ascending order, the descending sort of complete list can also be carried out.
Fig. 6 is the block diagram of the structure representing user PC 4.User PC 4 is common home-use personal computers, by the CPU 41 controlled molar behavior and the various Structure composing be connected with CPU 41.CPU 41 is connected with RAM 42, HDD 43, network I/F 44, operating portion 45, sound system (SS) 46 and Graphics Processing portion 48.The dynamic action routine be recorded in HDD 43 launches by CPU 41 in RAM 42, carries out various process.If user uses operating portion 45, carry out the display request singing file, then display request sends to central part 1 by CPU 41.Html file transmits (Notification URL is conducted interviews by user PC 4) to user PC 4 by the CPU 31 receiving the central part 1 of display request.In user PC 4, the WEB page based on the html file transmitted from central part 1 is shown at display 49 through Graphics Processing portion 48.Like this, the guide look singing file shown in Fig. 5 is shown.
If user uses operating portion 45, select the file of singing be presented in WEB page, then CPU 41 carries out the request of mixing data delivery.As request, by performing such as representing that the information singing filename sends to central part 1.The CPU 31 of central part 1 retrieves the filename of singing received from HDD 33, and file and synchronizing information are sung in reading accordingly.
CPU 31 plays read-out file of singing, generate singing voice signal, and the music data of melody described in synchronizing information numbering is read, according to the speed recorded in synchronizing information and information volume, utilizes sequencer to perform the performance of Karaoke melody.Generate note signal thus.
Generated note signal and singing voice signal are exported to frequency mixer 39 and carries out mixing.Voice signal after this mixing is inputted to CPU 31 again, generates as 1 compression sound data (mixing data).The mixing data of generation are sent to the user PC 4 that have issued request by CPU 31.Then, the mixing data of sending are play by the CPU 41 of user PC 4, utilize SS 46 to be transformed to analoging sound signal, and from loudspeaker 47 playback.
In addition, central part 1 also can link with the Fare Collection System of regulation, carries out charge process.After the amount of money user carrying out delivery request being collected to regulation, user PC 4 is made to download mixing data.In the case, chanteur singing acquisition remuneration when file is downloaded at every turn, therefore, by the interlock between Fare Collection System, thus can apply excitation to chanteur.
Like this, what user can listen to each chanteur sings sound and musical sound.Delivery system according to the present embodiment, such as, by being marked to listened to sound of singing by each user, thus can realize Karaoke match.
In addition, the delivery system according to the present embodiment, sings file owing to only uploading in central part 1, so can will sing sound and musical sound stores respectively in server, and does not make uplink time increase.Because the data (music data) of the data (singing file) Yu musical sound of singing sound are separately stored in the HDD 33 of central part 1, so can also easily realize changing mixing balance or modification effects individually in the later stage.
In addition, delivery system according to the present embodiment, also can carry out in the later stage multiple chanteur being sung the multiple record that sound (or identical chanteur sing sound) synthesizes.In existing system, owing to being the mode that will sing sound and musical sound and store in server as the voice data of 1 after mixing, so when the later stage add other sing sound, first voice data decoded and be transformed to voice signal, encode after other the voice signal singing sound is carried out mixing, therefore, tonequality deterioration is produced.But, in the present embodiment, due to will sound be sung and musical sound is preserved as different data, so wish that the file of singing of multiplex is decoded and synthesizes to when playing.Therefore, the tonequality deterioration caused by multiple record is not produced.
Below, use process flow diagram, the action of the delivery system of present embodiment is described.Fig. 7 is the process flow diagram of action when representing register.Fig. 8 is the process flow diagram of action when representing mixing data delivery.
First, as shown in Figure 7, if wish that the chanteur of public singing sound utilizes the operating portion 15 of Caraok device 7 to carry out singing the register of sound and the appointment of melody, then CPU11 accepts register (s11).Now, CPU 11 also accepts the brief introduction and message etc. that input chanteur from operating portion 15.
If CPU 11 receives register, then specified music data read and carry out Karaoke and play (s12), and based on the singing voice signal of the chanteur inputted via A/D transducer 17 from microphone 16, file (s13) is sung in generation.In addition, based on the melody numbering, speed, volume etc. of played melody, generate synchronizing information (s14).CPU 11, after the performance of melody terminates, sings file and synchronizing information is uploaded (s15) to central part 1 by generated.Central part 1 sings file and synchronizing information is recorded in (s16) in HDD 33 by uploaded.Like this, the file of singing of chanteur is logged in central part 1.The CPU 31 of central part 1 uses each chanteur's information singing file uploaded, and upgrades, and upgrade (s17) the WEB page that user PC 4 accesses html file.
Then, as shown in Figure 8, the guide look of the user (user of user PC 4) of request mixing data delivery chanteur in order to reference, and carry out the display request (s21) singing file.This display request sent to central part 1, central part 1 accepts WEB display request (s22).The CPU 31 of central part 1 carries out the WEB Graphics Processing (s23) transmitted to user PC 4 by html file.On the display 49 of user PC 4, show the WEB page (s24) based on the html file sent from central part 1.Like this, display 49 shows the guide look singing file shown in Fig. 5.
User by referring to the guide look singing file shown on display 49, thus selects the chanteur that hope is listened to, and carries out the delivery request (s25) of mixing data.CPU 41 extracts the user-selected filename singing file from html file, and notifies to central part 1.Thus, delivery request (s26) is accepted.
Then, at central part 1(or charging server etc.) and user PC 4 in carry out charge process (s27, s28), if charge process terminates, then corresponding is sung file and synchronizing information reading by the CPU 11 of central part 1 from HDD 33, carry out the decoding singing file, generate and sing speech tone signal based on what sing file.In addition, charge process is not necessary, can omit the process of s27 and s28 yet.Then, the music data of melody described in synchronizing information numbering is read from HDD 33, according to speed described in synchronizing information and volume, sequencing process is carried out to music data, and sound source 38 is controlled.Thus, reproducing to play Karaoka play with the speed identical with when singing the recording of sound, volume, synchronously playing (s29) by exporting the singing sound of chanteur simultaneously.But, play in the past and identically sung file, and when being stored in HDD 33 as mixing data, if read mixing data from HDD 33, then do not needed to re-start synchronous broadcasting.In addition, also can utilize the free time of the process of central part 1, generate each mixing data in advance.In the case, even if when there is multiple delivery request at the same time, also sending of mixing data can be carried out immediately.Certainly, in the case, be also kept in HDD 33 owing to singing file, so mixing balance can be changed in the later stage.
Then, mixing is carried out to the synchronous singing voice signal play and the note signal of playing Karaoka melody, generates mixing data (s30), user PC 4 is downloaded (s31).Now, the CPU 31 of central part 1 carries out count increments (s32) to the download time singing file be downloaded.
The CPU 41 of user PC 4 downloads mixing data (s33) from central part 1, and to HDD 43(or RAM 42) middle preservation.Then, CPU 41 carries out the decoding of mixing data, carries out the broadcasting (s34) singing sound and musical sound.
The generation of mixing data and send to concentrate accordingly with 1 first melody and carry out, also can download as flow data successively.In addition, also can be free when sending with low bitrate, charge when sending with high bit rate (bit rate during recording).
In addition, as shown in Fig. 3 (C) and Fig. 3 (D), in synchronizing information as represent the broadcasting timing respectively singing file information and record represent elapsed time from playing information or mistiming of singing between file (for file of singing at first, the time counted from playing) when, in the CPU 31 of central part 1, along with the sequencing process of music data, and export based on the voice signal respectively singing file.When synchronizing information is formed as MIDI data (the expansion rail of music data), by being read the MIDI data of this synchronizing information by sequencer, thus the voice signal based on respectively singing file can be exported.
Here, user, operating portion 45 is operated, carry out mixing balance change instruction when (s35), CPU 41 to central part 1 carry out changes asks (s36).In change request, the mixing included singing sound and musical sound balances the information indicated.If the CPU 31 of central part 1 receives the request of changing (s37), then according to the information of the expression mixing balance comprised in this change request, change the mixing balance of frequency mixer 39, regenerate mixing data (s38).Then, the mixing data after again generating to be sent (s39) to the user PC 4 having carried out the request of changing by CPU 31.In user PC 4, the mixing data of again sending are play (s40), till broadcasting terminates, repeatedly carry out above process (s41).
In addition, for the mixing data of again sending, again can send from the midway of the melody of having made the request of change, also can from melody at first again send with the mixing balance after changing.
As noted above, in the present embodiment, owing to singing sound and musical sound is formed by different sources, so volume can be controlled independently, mixing balance easily can be changed.
In addition, in the change instruction that user also can balance in above-mentioned mixing, the instruction of the change instruction of effect, speed change is carried out.When carrying out the instruction of speed change, the CPU 31 of central part 1 carries out the sequencing process of music data with the speed after change, and also carries out the change of the broadcasting speed singing file.In the case, CPU 31(or not shown DSP) carry out following process, that is, while the interval of sound is sung in maintenance, make voice signal stretch on a timeline.The process making voice signal flexible on a timeline while keeping singing the interval of sound, such as, carry out in the following manner.
That is, CPU 31 will be the time shaft waveform in units of the sampling period based on the voice signal cutting singing sound singing file, generate the new time shaft waveform (middle waveform) obtained by multiple time shaft Waveform composition.Middle waveform is by synthesizing the smoothing conversion of time shaft waveform (cross-fade) of front and back, thus generate.Further, if insert middle waveform between original time shaft waveform, then while the interval of sound is sung in maintenance, can stretch on a timeline.When compressing voice data, carry out utilizing middle waveform to replace the process of original time shaft waveform.Such as, if carry out insertion process every 1 sampling, then can be stretched as 2 times (broadcasting speed is 1/2), if carry out replacement Treatment, then can carry out compressing (making broadcasting speed become 2 times).If carry out insertion process every 2 samplings, then 1.5 times can be stretched as, if carry out insertion process every 3 samplings, then 1.33 times can be stretched as.
In addition, CPU 31 is when user indicates tone to change, and the tone carrying out music data changes (replacing of note numbers (note number)), and the pitch (pitch) carrying out singing voice signal changes.Pitch changes and can realize by carrying out the resampling of voice signal.In addition, the frequency characteristic also can carrying out voice signal changes.
In addition, in the present embodiment, show chanteur and use Caraok device 7 to carry out singing the example of the operation that file logs in, but also can be configured to, the function of additional microphone and recording in central part 1, use central part 1 to log in and sing file.More simply, also can use the user PC 4 of the function achieving Caraok device 7 and realize.In the case, the textural elements such as the software simulating sequencer of user PC 4 and sound source, form Karaoke and play terminal.
In addition, for singing listening to of file, showing the example using common home-use personal computer, but Caraok device 7 can certainly be used to listen to.
In the present embodiment, as shown in Fig. 3 (B), describe the example that synchronizing information is made up of head, velocity information, information volume (Vol.), timing information (velocity variable).But, in synchronizing information, except above-mentioned information, also can comprise that microphone echoes, reverberation, compression, the change of voice etc. efficacy parameter.In the case, when singing the register of sound, log in the synchronizing information comprising efficacy parameter.Specifically, such as, in the process timing that the synchronizing information of the s14 of Fig. 7 generates, the efficacy parameter now set by Caraok device 7 is reflected in synchronizing information.Play Karaoka play time, use this efficacy parameter, microphone to be echoed etc. and reflect in voice signal.Thus, the effect set when singing sound recording can be reflected in Karaoke performance, the user sent accepting mixing data can enjoy the performance having more presence.
In the present embodiment, carry out charge process when mixing data delivery, but also can carry out charge process when chanteur uploads and sings file.That is, sing file and synchronizing information when uploading during register in the s11 of Fig. 7 and in s15, charge to chanteur.Thus, the system of following purposes can be realized, that is, such as hold chanteur can pay the Karaoke match participated in time, upload self sing file time from each chanteur's collection cost as initial charge.
The explanation of symbol
1 ... central part
2 ... network
3 ... Karaoke shop
4 ... user PC
5 ... repeater
7 ... Caraok device

Claims (3)

1. a server, it has:
Receiving element, it receives the voice data of chanteur and the voice data of described chanteur and the synchronizing information played of playing Karaoka;
Storage unit, it stores the voice data of described chanteur, synchronizing information and for carrying out the music data played of playing Karaoka;
Voice data generation unit, it is play described voice data, and based on described synchronizing information, reads described music data, carries out automatic Playing,
Mixing is carried out to the sound of the voice data based on described broadcasting and the musical sound of described automatic Playing, generates mixing data; And
Delivery unit, it sends the mixing data that described voice data generation unit generates,
The feature of this server is,
In described synchronizing information, record speed and the information volume of the Karaoke melody played when described voice data recording,
Described voice data generation unit, when the change instruction receiving mixing balance, changes based on the mixing balance between the sound of described voice data and the musical sound of described automatic Playing according to this change instruction,
Described delivery unit by change mixing balance after mixing data send.
2. server according to claim 1, wherein,
Described voice data is made up of multiple voice data,
In described synchronizing information, comprise the information of the respective broadcasting timing representing described multiple voice data.
3. server according to claim 1 and 2, wherein,
Described storage unit also stores the mixing data that described voice data generation unit generates,
Described delivery unit reads described mixing data and sends from described storage unit.
CN201180014836.1A 2010-03-19 2011-03-17 mixing data delivery server Expired - Fee Related CN102822887B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2010-063427 2010-03-19
JP2010063427A JP5544961B2 (en) 2010-03-19 2010-03-19 server
PCT/JP2011/056395 WO2011115210A1 (en) 2010-03-19 2011-03-17 Mixing data delivery server

Publications (2)

Publication Number Publication Date
CN102822887A CN102822887A (en) 2012-12-12
CN102822887B true CN102822887B (en) 2015-09-16

Family

ID=44649293

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201180014836.1A Expired - Fee Related CN102822887B (en) 2010-03-19 2011-03-17 mixing data delivery server

Country Status (4)

Country Link
JP (1) JP5544961B2 (en)
KR (1) KR101453177B1 (en)
CN (1) CN102822887B (en)
WO (1) WO2011115210A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013231944A (en) * 2012-04-02 2013-11-14 Yamaha Corp Singing support device
JP6413828B2 (en) * 2015-02-20 2018-10-31 ブラザー工業株式会社 Information processing method, information processing apparatus, and program
CN105095461A (en) * 2015-07-29 2015-11-25 张阳 Family karaoke ordering method and system
CN105791937A (en) * 2016-03-04 2016-07-20 华为技术有限公司 Audio/video processing method and related equipment

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1120229A (en) * 1994-07-26 1996-04-10 三星电子株式会社 Video-song accompaniment apparatus for reproducing accompaniment sound of particular instrument

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1152966A (en) * 1997-08-01 1999-02-26 Ricoh Co Ltd Music playing system
JP4188013B2 (en) * 2002-07-17 2008-11-26 株式会社第一興商 A communication karaoke system and a karaoke performance device capable of collecting and singing a singing track recording file entrusted to a file storage server to the karaoke performance device.
JP4042601B2 (en) * 2003-03-25 2008-02-06 ブラザー工業株式会社 Recording / playback device
JP2005352330A (en) * 2004-06-14 2005-12-22 Heartful Wing:Kk Speech division recording device
JP2006184684A (en) * 2004-12-28 2006-07-13 Xing Inc Music reproducing device
JP2006215460A (en) * 2005-02-07 2006-08-17 Faith Inc Karaoke sound transmitting and receiving system and method therefor
JP2007225934A (en) * 2006-02-23 2007-09-06 Xing Inc Karaoke system and host device for the same

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1120229A (en) * 1994-07-26 1996-04-10 三星电子株式会社 Video-song accompaniment apparatus for reproducing accompaniment sound of particular instrument

Also Published As

Publication number Publication date
CN102822887A (en) 2012-12-12
KR101453177B1 (en) 2014-10-22
WO2011115210A1 (en) 2011-09-22
KR20120128142A (en) 2012-11-26
JP5544961B2 (en) 2014-07-09
JP2011197344A (en) 2011-10-06

Similar Documents

Publication Publication Date Title
US11361671B2 (en) Video gaming console that synchronizes digital images with variations in musical tempo
TW495735B (en) Audio controller and the portable terminal and system using the same
KR100919454B1 (en) Music reproducing system for collaboration, program reproducer, music data distributor and program producer
US20070227338A1 (en) Interactive digital music recorder and player
US7622664B2 (en) Performance control system, performance control apparatus, performance control method, program for implementing the method, and storage medium storing the program
CN103403794B (en) Automatic musical performance device
US11120782B1 (en) System, method, and non-transitory computer-readable storage medium for collaborating on a musical composition over a communication network
US20020144587A1 (en) Virtual music system
CN102822887B (en) mixing data delivery server
US20020144588A1 (en) Multimedia data file
JP4175337B2 (en) Karaoke equipment
WO2011111825A1 (en) Karaoke system and karaoke performance terminal
KR101029483B1 (en) Equipment and method manufacture ucc music use a file audio multi-channel
JP3900576B2 (en) Music information playback device
JP2018112725A (en) Music content transmitting device, music content transmitting program and music content transmitting method
JP2002108375A (en) Device and method for converting karaoke music data
JP2018112724A (en) Performance guide device, performance guide program and performance guide method
JP5040356B2 (en) Automatic performance device, playback system, distribution system, and program
JP2010054856A (en) Electronic musical instrument
JP3178462B2 (en) Music data distribution device
JP2014048471A (en) Server, and music reproduction system
JP2007079413A (en) Audio reproduction device, audio distribution system, audio reproduction program and authoring program
JPH10247090A (en) Transmitting method, recording method, recording medium, reproducing method, and reproducing device for musical sound information
JP2007133440A (en) Music information reproducing apparatus
KR20040100706A (en) Web-based Karaoke Recorder(WKR) technique and BM(Business Model)s like Novata(Singing Avata) and Karoke BBS using WKR

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150916

Termination date: 20180317